Server list problem

When I start loading in servers they load in highest pop to lowest pop. I want to play on a smaller server and see a bunch with 20-30 people but it loads in very fast, and I scroll down but then it starts cutting these smaller servers out of the list and eventually I can’t see any servers with less than 60 people, how do I fix this?