[asdfxD]

type status in rcon console, maybe server lose connection to steam/master server.

the status command will prove it. it says something "secure mode enabled, disconnected from steam3" bla bla.

maybe this is the issue as you said it works fine when you restart the server, so the connection between your server <-> steam is fine again and after some minutes/hours the server lose the connection and nobody can join.