No, you got it wrong.
Entity_FindByName searches for a name, not classname, but it needs the classname to be specified, otherwise it has no way of finding none-edicts (serverside, logical or brush entities).
It's not possible to write a "wrapper" that searches for ALL entities without specifying a classname, it's a Sourcemod Limit. ok nvm, psychonic forces me to use dirty haxx to iterate over all entities without classnames
I will consider adding it to the next smlib version.
But I would say if you want to get an entity by it's name, you know its classname mostly too, otherwise use Edict_FindByName().
I don't extend Valve's confusion, I escape it by naming it correctly.