After testing a few things out we noticed if only one person was on the server for the warm up round the server would crash, tried it with a person on each team and everything was okay.
Disabled it and tried just a round and killing oneself and no more crashes, in the log files this is all I can see.
Code:
L 02/07/2011 - 23:20:06: [SM] [0] Line 361, /home/groups/alliedmodders/forums/files/2/9/4/0/9/81891.attach::Panel_Callback()
L 02/07/2011 - 23:20:06: [SM] Native "CloseHandle" reported: Handle 0 is invalid (error 4)
L 02/07/2011 - 23:20:06: [SM] Displaying call stack trace for plugin "tf2_pregame.smx
Going to put it on a test server later today and do a few more tests and see whats going on.