Server hit by huge game crash issue

[mik7727]

Hello, facepunch forum.

I´m having this huuuge problem at my server, there started 2 weeks ago.

The issue:
For two weeks a gamecrash issue startet when there is around 30-50 peoples in the server around 10-90 min ( huge gab) the game for ALL people just crash with this message. Engine error "render.PopFilterMag underflow"
Picture: [url]https://gyazo.com/23774d466625eb2488ee5c2e59e90b0c[/url]

I got told so many times thats an addon but I can now confirm its not. I removed all the addons from the workshop 10 by 10. That will say I first remove 10 and when it crash i re-add the 10 I removed and removed another 10 untill all was removed.

And its still happending please help!

Thanks!

[John Beton]

I have the same problem, and i have tryed looking trough my crash log, but i don't exactly know how to track down the issue... [url]http://dumps.metastruct.uk.to/dumper.py?dump=hl2_161029_crash_2016_11_6T18_56_39C0.mdmp[/url]

[Rubat]

if CLIENT then
local count = 0
local render_PopFilterMag = render.PopFilterMag
function render.PopFilterMag()
	count = count - 1
	if ( count < 0 ) then debug.Trace() end
	render_PopFilterMag()
end

local render_PushFilterMag = render.PushFilterMag
function render.PushFilterMag( n )
	count = count + 1
	render_PushFilterMag( n )
end

end

Add this on the bottom of lua/includes/init.lua [b]of your server[/b] and when you crash, post the crash log. ( .mdmp file )

[mik7727]

Thanks alot Robotboy655. Ill try that :)!

[John Beton]

Here is my new crash log (mdmp file) after i did what you told, Robotboy655 :)

[url]http://dumps.metastruct.uk.to/dumper.py?dump=hl2_161029_crash_2016_11_11T22_37_35C0.mdmp&key=med5i4JXj_J_bZA48Kd0yWbtbtW2_o0HqzXu0xflDNiMLj2kI-qFWD94PHVmd2-XauPHzWeyylwRM3jr0yM8fEP708_zmNqodN4NiNgxVwUxSqtPUDMaAxML1DExb7wBma4BtDmgaC1IE8fsiIcyUUIFAk28tR_FZze_Br7bxKo=[/url]

[Rubat]

Uhh, some backdoored addon is maliciously crashing your clients using Player.SendLua()

[mik7727]

[url]http://dumps.metastruct.uk.to/dumper.py?dump=hl2_161029_crash_2016_11_11T22_37_35C0.mdmp&key=med5i4JXj_J_bZA48Kd0yWbtbtW2_o0HqzXu0xflDNiMLj2kI-qFWD94PHVmd2-XauPHzWeyylwRM3jr0yM8fEP708_zmNqodN4NiNgxVwUxSqtPUDMaAxML1DExb7wBma4BtDmgaC1IE8fsiIcyUUIFAk28tR_FZze_Br7bxKo=[/url]

Same crash log as John Beton :)

Robotboy655 you know the issue?

[editline]12th November 2016[/editline]

[QUOTE=Robotboy655;51356060]Uhh, some backdoored addon is maliciously crashing your clients using Player.SendLua()[/QUOTE]

Normaly backdoors are coming thre workshop addons but I most likely have addons from peoples that you know cant make the issue like Detective TDM, Lonewolf and others ( you can go check out ) - No one seems to be an error like the drug mod on the workshop and I didnt add anything new exept of 3 addons past 3 months. and the 3 I addet I already tried to remove.
[url]http://steamcommunity.com/sharedfiles/filedetails/?id=353743579[/url]

[Rubat]

Yeah like I just said and have been telling you from the start, some shitty backdoored addon is causing the problem you are having.

[editline]12th November 2016[/editline]

if SERVER then
	local fuck = FindMetaTable( "Player" )
	local shit = fuck.SendLua
	function fuck:SendLua( cmd )
		debug.Trace()
		shit( self, cmd )
	end
end

Add this to the aforementioned file, removing the code you added before.

It will spam your server's console a bit, but it will reveal the file that is crashing your clients.

Look for blue spam in the server's console when your clients crash. Then paste it here.

The text will look something like this:
[img]http://i.imgur.com/W4ghVHF.png[/img]

[mik7727]

Its now done, there will come more news tomorrow after there is 35+ in when it all start to happend

[mik7727]

Hello Robotboy655,

Isnt there a faster way to find the backdoor today, a guy hacked the server by the backdoor and added everybody high ranks + set all money to 0
We have it under control now, but isnt there a way to find it?

[Rubat]

Go through each addon manually and look for addons. As I have already told you from the beginning - one of your addons is backdoored. I told you that weeks ago and you did nothing about it.

[mik7727]

Robotboy655 I did, I removed 80 addons?

I just dont thing it cant be an addon from one of the huge workshop masters like Lonewolie and stuff

[Rubat]

It can be from ANY ONE addon.

[mik7727]

I puttet the thing in the aforemental file, and unbanned everybody.

When there is 35-40 in and the server crash ill look the console and send the picture to you in this thread.

[mik7727]

Hey again,

After Ill added this text to txt. alot weird thing have happend
first one guy hacked superadmin by the backdoor and fucked up
But the weird thing is after i added the commend the server didnt crash with 45 players in the most of the day in 4 hours? - How to find the backdoor if it doesnt crash?