Multiplayer with friends

my friend just got garrys mod but whenever i try to invite him or he tries to invite me it wont let either of us join a game and it just says the server is not responding. does anyone out there know why that is?

Forward your ports.