Its not my internet connection, 3 of my friends also get high latency after playing for about 20 minutes on a realm, on pc and xbox, so the way we solve it is closing and re-openning minecraft, it did work every single time for all of us, we still do not know whats exactly giving us that problem, because if its other game there is never high latency , i think the game starts asking for lots of packets and it only gets worse with time without closing and re-openning.