When myself and a friend are playing on split screen on a realm, the player 2 controller seems to freak out in the inventory and pause menu, like, the whole controller takes over.

at first we thought it was just the controller, but when we went in the home menu, the controller seemed perfectly fine but going back on Minecraft a few minutes later, it's still freaking out. 

We've tried turning the controller off, resetting Minecraft, resetting the Xbox but it still goes and freaks out until after a few minutes of putting up with it, it just suddenly stops. 

Hope you can answer to this and tell what the problem is! Many thanks!