Dedicated Server ( Some people can see it, some can't ).

Help!

So I have opened a server and some people can see it, and some can’t.
Like 7 / 10 people will see it, and the rest it will come up not responding.
And when they try connect it will fail.

Is it always the same people who can’t see it or can they see it just sometimes?