There are multiple older duplicates of this bug but I believe that they may be unrelated.

When using a single display:
After entering fullscreen in a menu the cursor does not hide when swapping into first person.
Also, if the cursor is hidden when entering fullscreen, i.e. when not in a menu, the cursor is invisible when navigating menus/ui.

When using multiple displays:
The mouse is always hidden.