Originally Posted by http://forums.srcds.com/viewtopic/14306
I would like to thank Joonas from the srcds_linux mailing list for identifying what "Alarm clock" is. I went to go search for it on google (srcds SIGALRM) and I found this: http://noteand.blog.eonet.jp/weblog/2009...-da30.html
Quote:
"* The linux dedicated server supports a watchdog timer functionality,
which is enabled by default. The intent of this timer is to make
anything which hangs the server, either due to unknown bugs or
misconfiguration, cause an abort, so that the server may restart or
be debugged. In the case of a forked server, this will cause a new
subprocess to start to replace the crashed one. On a non-forked
server, this can be used in conjunction with an auto-restart script
in order to increase server availability. If you see your server
dying with SIGALRM (signal 14), it means that this has triggered
because of either a server frame taking longer than 5 seconds of
wall time, or a map load taking too long. If this code causes
trouble for you, it can be disabled via giving the "-nowatchdog"
option on the command line."
I put the -nowatchdog switch in srcds_run and switching to something like realism, mutation, etc. from the lobby with sv_search_key WORKS now! I think reliability might be an issue, so now I have to test out how much I can push out of my old linux box.
Not sure if it's better to start a new thread or tack on an existing thread for the same topic that's almost a decade old, but we had this issue last night with 3 (out of our 11) servers -tokyo, singapore, and australia locations.
We have 11 servers total, hosted on the same OS (Ubuntu 18.04.5 LTS) and provider (Vultr). Once per day each server rsyncs server updates from a github repo we keep up-to-date. So the servers that where working had the same exact config as the servers that where throwing this error, except some files mostly related to gamedata stuff SM keeps updated ( line 41-57 here )
The servers throwing the error would start up correctly and around 30 seconds later would come up with the Alarm clock message, then reboot.
Code:
VAC secure mode is activated.
L 09/07/2021 - 02:58:11: [GasConfig_v2.smx] [GasConfig] Connected to the database successfully.
ConVarRef mat_hdr_manual_tonemap_rate doesn't point to an existing ConVar
atrium map script
L 09/07/2021 - 02:58:12: [OnLogAction_To_DB.smx] Connected to the database successfully.
L 09/07/2021 - 02:58:12: [SurvivalRecorder.smx] Connected to the database successfully.
L 09/07/2021 - 02:58:14: [SurvivalRecorder.smx] Database tables initialized successfully
Alarm clock
Add "-debug" to the /root/L4D2/srcds_run command line to generate a debug.log to help with solving this problem
Tue Sep 7 03:00:04 UTC 2021: Server restart in 10 seconds
Accelerator didn't pick anything up so I tried the default "-debug" launch setting which ended up being useless:
Code:
CRASH: Tue Sep 7 04:27:42 UTC 2021
Start Line: ./srcds_linux -game left4dead2 -tickrate 30 -ip 45.32.29.94 -port 27015 +map c1m4_atrium +mp_gamemode survival +tv_enable 1 -debug
End of Source crash report
Hostname wasn't showing up either except for ~ 1 second after launch (it gets relaunched automatically from a running shell script) - https://youtu.be/hzM6Wo-ZgaE
tried -nowatchdog and I was able to join one server that ended up crashing soon after. Tried loading the same server and it crashed while loading from lobby but generated a .dmp crash log file: https://www.dropbox.com/s/mlc900tl72...45_28.dmp?dl=0
Also tried to diffcheck the console output from bootup to "Database tables initialized successfully" for a working server and one erroring out; no major differences.
Only our Australia server is still having the issue but I don't have FTP access as someone else is sponsoring that location.
Made this post in-case I luck out and someone might've had this issue before
meta list
Code:
Listing 7 plugins:
[01] SourceMod (1.10.0.6502) by AlliedModders LLC
[02] L4DToolZ (1.0.0.9r1) by Ivailosp
[03] SourceTV Support (0.9.10) by Evgeniy "shqke" Kazakov
[04] SDK Tools (1.10.0.6502) by AlliedModders LLC
[05] SDK Hooks (1.10.0.6502) by AlliedModders LLC
[06] SteamWorks Extension (1.2.3) by Kyle Sanderson
[07] SourceTV Manager (1.2) by Peace-Maker
plugin list
Spoiler
Code:
sm plugins list
[SM] Listing 60 plugins:
01 "SlayBots" (1.0) by khan
02 "SourceBans++: SourceComms" (1.6.3) by Alex, SourceBans++ Dev Team
03 "SourceBans++: SourceSleuth" (1.6.3) by ecca, SourceBans++ Dev Team
04 "[NativeVotes] KickSpec" by Keith Warren (Sky Guardian)
05 "sv_steamgroup fixer" (1.1.0) by asherkin
06 "Gas Configs" (2.0) by khan
07 "SourceBans++: Admin Config Loader" (1.6.3) by AlliedModders LLC, SourceBans++ Dev Team
08 "Sound Commands" (1.10.0.6502) by AlliedModders LLC
09 "Cannounce patch" (1.0) by dustin
10 "Fun Votes" (1.10.0.6502) by AlliedModders LLC
11 "Friendly Fire Report" (1.1) by Gravity
12 "L4D2 Laser Sights" (1.0) by khan
13 "SMAC Eye Angle Test" (0.8.6.6) by SMAC Development Team (original), Mr. Silence (updated)
14 "[L4D2] Weapon/Zombie Spawner" (1.0a) by Zuko & McFlurry
15 "Survival Stats Tracker" (1.1) by khan
16 "NativeVotes" (1.1.1) by Powerlord
17 "Basic Info Triggers" (1.10.0.6502) by AlliedModders LLC
18 "SetName" (1.0) by khan
19 "SourceBans++ Report Plugin" (1.6.3) by RumbleFrog, SourceBans++ Dev Team
20 "SI spawner" (1.0) by khan
21 "Noclip" (1.0) by khan
22 "Basic Comm Control" (1.10.0.6502) by AlliedModders LLC
23 "SourceBans++: Main Plugin" (1.6.3) by SourceBans Development Team, SourceBans++ Dev Team
24 "Basic Chat" (1.10.0.6502) by AlliedModders LLC
25 "SMAC Rcon Locker" (0.8.6.6) by SMAC Development Team (original), Mr. Silence (updated)
26 "Random Map" (2.0) by khan, dustin
27 "Connect Announce" (1.8) by Arg!
28 "SMAC Client Protection" (0.8.7.3) by SMAC Development Team
29 "SMAC L4D2 Exploit Fixes" (0.8.6.6) by SMAC Development Team (original), Mr. Silence (updated)
30 "SMAC Anti-Speedhack" (0.8.6.6) by SMAC Development Team (original), Mr. Silence (updated)
31 "slots" by unknown
32 "Who shot the gas??" (1.0) by khan
33 "Admin Menu" (1.10.0.6502) by AlliedModders LLC
34 "Log Actions to DB" (1.0) by dustin
35 "SourceTV Survival Recorded" (1.2) by dustin
36 "Force spec" (1.0) by dustin
37 "Medkit Statistics" (1.1) by dustin
38 "SourceMod Anti-Cheat" (0.8.7.3) by SMAC Development Team
39 "Survival Auto Heal" (1.0) by khan
40 "Block non-ingame commands" (1.0) by dustin, cravenge
41 "Reset Server When Empty" (1.2.0) by dustin
42 "Fix Item Properties" (1.0) by Gravity
43 "Team Select" (1.0) by khan
44 "Basic Commands" (1.10.0.6502) by AlliedModders LLC
45 "SMAC Aimbot Detector" (0.8.6.6) by SMAC Development Team (original), Mr. Silence (updated)
46 "Admin File Reader" (1.10.0.6502) by AlliedModders LLC
47 "Client Preferences" (1.10.0.6502) by AlliedModders LLC
48 "Basic Votes" (1.10.0.6502) by AlliedModders LLC
49 "Player Commands" (1.10.0.6502) by AlliedModders LLC
50 "Fun Commands" (1.10.0.6502) by AlliedModders LLC
51 "l4d2_changelevel" (1.2.0) by Lux
52 "SMAC AutoTrigger Detector" (0.8.6.6) by SMAC Development Team (original), Mr. Silence (updated)
53 "Welcome Message" (1.0) by dustin
54 "Anti-Flood" (1.10.0.6502) by AlliedModders LLC
55 "Reserved Slots" (1.10.0.6502) by AlliedModders LLC
56 "Admin Help" (1.10.0.6502) by AlliedModders LLC
57 "SurvivalTimeFixes" (1.0) by khan
58 "SourceBans++: Bans Checker" (1.6.3) by psychonic, Ca$h Munny, SourceBans++ Dev Team
59 "Too Late To Ban" (1.0.0a) by Shenton
60 "Idle blocker" (1.0) by dustin
Edit
Issue resolved itself shortly after. If it happens again I'll look more into it
Spoiler
Code:
[Yesterday, 10:35 AM]
shqke:
Alarm clock is just frame too much time to process
perhaps non threaded mysql queries
[Yesterday, 10:44 AM]
shqke:
blocking operations is a way to look into
[Yesterday, 10:26 PM]
dustin:
do you mean linux operations? or operations on the game server (disabling a few plugins / extensions at a time)
Tuesday, September 7, 2021
[3:54 AM]
shqke:
blocking io - file reads, non threaded SQLit's simple to know what may hang
and how to debug.. profiler with nowatchdog is one way
sm prof or vprof (they work around same calls)
Last edited by dustinandband; 09-08-2021 at 12:37.