Server Frame Drops with Net Graph etc

Hi,
Im about to publish a DarkRP Server and got all ready but I dont know what to do with the frame drops.
It cant be the server as you can see here http://prntscr.com/g16yit . This is the Net Graph when I have such Frame Drops: https://prnt.sc/g171w8
As I can see there its client side but I have a pretty decent PC so I hope anyone can explain it to me.
Best regards Azoni

Edit:
this is the collection: http://steamcommunity.com/sharedfiles/filedetails/?id=919684856
+some gmodstore addons like VCMod + ELS, Arcbank etc

Do you happen to have a lot of entities such as chess boards, arcade machines, etc out and setup? That contibutes to a lot of fps lag on my server