Cant join game again

Hey guys,
if I go to the Desktop and do something, i cant join the game again. If i press to the GMOD symbol, i get kicked to the desktop. I ve to close GMOD and start it again to play again.

Why I cant join the game if i go to desktop?