are you hosting this on your network? I'm going to assume that you are. Leave sv_allow_lobby_connect_only at 0 then go into our l4d2 game and in options>multiplayer make sure auto discover lan games is disabled, you don't want this showing up on your steam group list.
You need to create an autoexec.cfg in C:\Program Files (x86)\Steam\SteamApps\common\left 4 dead 2\left4dead2\cfg and in that autoexec.cfg you will put the following
mm_dedicated_force_servers "xx.xx.xx.xx
xxx" replacing xx with server ip:port
what this does is allow you to create a lobby with any settings you choose and then when you click start the game it will automatically connect to your server. This is assuming your hosting a dedicated server on your network on a machine other than the one your playing on.