When pressing the key to exit inventory (and keeping the mouse stationary) the camera behaves as expected.

If you press the key to exit inventory (while moving the mouse) the view will spin dramatically causing the player to face a random direction.