GMod New Player Issues

So just recently I started a new TTT server. My friends have been able to join, some others have been hit or miss. I have a collection added to the server with the workshop.lua embedded to the server startup folder. So players are able to download the content without an issue. Also players are able to connect without an issue. The issue I have is either with the sending client info or when players are done compiling addons. The player would disconnect and the server console only tells me that the player disconnects. Player maximum cap is not an issue, but so far I have already lost 100 players due to players not loading in successfully.

Is there any fix for this?

Use less addons.