Invisible People

I recently bought a gmod server and i have been adding addons and m9k base and such but i noticed that sometimes people just randomly turn invisible. I can see it as well but i have fastdl installed and workshop download installed. It also happens with certain guns. Also only the custom playermodels turn invisible, and sometimes other players can see them and sometimes they can. If anyone knows how to fix this please reply.