Increase your router’s NAT session per user.
My router is Zyxel and the setting is under the NAT section. I do not know where it is on other routers.
My NAT/Firewall Session per user was set to 512 and I was only loading servers by counts of 200 every 30 seconds. It is now set to 1000 and loads 500 servers every 30 seconds. Increase the setting even more and you can imagine what happens. I do not know what this will do to the other computers on your network, but if you are the only one who games in your house you should be fine. This is a fix for those who are frustrated with not being able to see the servers their friends are on.