Desyncing

So I found a server where I dont get packet loss anymore, but now I have to deal with desyncing every 10mins or so again. Any way I can fix this?