Mini freezes on many servers

Hey there!

Wanted to know what this is about. I get a mini freeze every four seconds, for about 300-400ms on pretty much 98% of the servers that I join. The ping doesn’t matter, it can be low or high.
Population and structures also don’t seem to be the cause, neither does map size or anything. My connection seems to be fine as well. I tried to play on the official Amsterdam server and the “lags” were gone after a few minutes, some servers didn’t have any at all.

Any suggestions on how to deal with this annoying stuff?