Having a hard time removing severs...

Umm well I’m new here and I’ve been having a hard time removing my Favorite Severs from TF2 and Garrysmod, when I right click it and click “Remove from Favorites” it just clicks out, so I refresh and the page is still there! Is there a way I can go in the garrysmod folder and remove that way or something? Or is there another way?