Server Issue

Me and my friend recently started a ttt server and it runs very well but anytime anybody connects they have to download a bunch of materials\vgui icons and such. Is there a way to make this not happen anymore because I have never had this issue on other servers.