I did some tests, and wasn't able to reproduce, check if you are using the latest file from the main post.
Maybe I updated it at some point and didn't change the version.
If possible, share the map name and where it does happen.
I tested on c5m5_bridge, and all times I loaded the plugin for the first time it does respect the chance cvar.