Context:
On
18st Jan added 1 new model to server.
On
23rd Jan added 10+ new modelss to server.
Today (
27 Jan) server is crashing on startup (crash loop). I've spend 7+ hours trying to fix it since.
Issue:
My server is crashing on restart (during the time period SM plugins are loading).
To clarify, it crashes before any players join (although GOTV client will be in) as each plugin loads.
I noticed this only today after the server crashed (for another known reason).
It then started to crash loop.
There are no accelerator dumps or any other error/issue in logs anywhere.
I have
90 plugins on the server.
Starting the server with
1 of them disabled fixes the issue.
This
1 plugin
easydownloader (which I wrote myself):
https://forums.alliedmods.net/showthread.php?p=2482408
Okay so looks like some sort of precache/downloads issue?
Server could have been up since the
23rd Jan (without restarting) so its likely related to changes made then.
I find out if I restore the old downloads config, the server starts and works. (the one prior to 23 Jan changes).
I find out if I remove the models/download only lines in the downloads config bit by bit it works. (this is decreasing the entries in stringtables downloadsonly and modelprecache)
It doesn't seem to be an issue with any particular model/material/file. Just the total number of files in the stringtables.
So either the plugin is broken or I'm reaching string table limits right?
I tried another download plugins and it resulted in the same behaviour.
Different maps result in a borderline working config to work (because each map has different number of models etc). So one config that didn't work on a custom map worked on de_dust2.
If I start the server without
easydownloader.smx and then late load the plugin. I can map change, players can leave join etc until the next server restart/crash in which case it goes back to crash looping. So lateloading the plugin works but if it was a strings table limit issue, shouldn't lateloading also cause a crash?
There have been no recent CSGO updates that seem relevant.
I run GOTV 24/7 and have for years. Could recent GOTV updates be related?
I wasn't affected by the
precaching in the wrong spot issue that occurred a while ago because I ran GOTV. However, I did go back and check most plugins to ensure they precached in
OnMapStart. I will double check this shortly.
When looking at
dumpstringtables with a config that is working (but about to crash).
In other words if I add say 10 files to the downloadstable/modelprecache I crash:
Code:
Table downloadables (changed on ticks 67, 65)
1555/8192 items
Table modelprecache (changed on ticks 65, 0)
1164/4096 items
Table genericprecache (changed on ticks 65, 0)
2/512 items
Table soundprecache (changed on ticks 67, 65)
2209/8192 items
Table decalprecache (changed on ticks 65, 0)
118/512 items
Table instancebaseline (changed on ticks 745, 714)
34/1024 items
Table lightstyles (changed on ticks 65, 0)
64/64 items
Table userinfo (changed on ticks 65, 0)
255/256 items
Table dynamicmodel (changed on ticks 0, 0)
0/4096 items
Table server_query_info (changed on ticks 65, 0)
1/4 items
Table ExtraParticleFilesTable (changed on ticks 65, 0)
1/1024 items
Table ParticleEffectNames (changed on ticks 65, 0)
580/1024 items
Table EffectDispatch (changed on ticks 65, 0)
41/1024 items
Table VguiScreen (changed on ticks 65, 0)
2/256 items
Table Materials (changed on ticks 65, 0)
2/1024 items
Table InfoPanel (changed on ticks 65, 0)
1/128 items
Table Scenes (changed on ticks 0, 0)
0/8192 items
Table Movies (changed on ticks 0, 0)
0/16 items
Table GameRulesCreation (changed on ticks 65, 0)
1/1 items
Things I've tried:
I've spend so much time trying so many things:
- Reuploaded custom content (models/materials)
- Recompiled easydownloaderplugin
- Disable a whole lot of plugins (doesn't seem to matter, only if easydownloader is present the crash occurs)
- Verify steam installation
- Right now my server is up and running with players using the lateload thing I mentioned. However, I need to actually fix the issue so restarts work.
Any help/ideas tips are massively appreciated as my brain is hurting.
Server Info:
Code:
SourceMod Version Information:
SourceMod Version: 1.9.0.6223
SourcePawn Engine: 1.9.0.6223, jit-x86 (build 1.9.0.6223)
SourcePawn API: v1 = 4, v2 = 12
Compiled on: Dec 19 2017 21:42:42
Built from: https://github.com/alliedmodders/sourcemod/commit/309e6ae
Build ID: 6223:309e6ae
http://www.sourcemod.net/
Code:
Metamod:Source version 1.10.7-dev
Built from: https://github.com/alliedmodders/metamod-source/commit/89c6fb3
Build ID: 956:89c6fb3
Loaded As: Valve Server Plugin
Compiled on: Apr 26 2017
Plugin interface version: 15:14
SourceHook version: 5:5
http://www.metamodsource.net/
__________________