Game randomly freezes while playing with friends(4 players)

What I expected to happen was...:
Game should run without freezing

What actually happened was...:
Game froze for some players

Steps to Reproduce:
1. Play the game for a while with friends (4 players)
2. Game freezes. Sometimes some of the other players on the realm also experience this
3. Quit the game/realm

4. Wait for the game to indicate that you left(ask other players to let you know when the notifications appears)

5. Join the realm/session again, only once the notification indicated that you left the game