From my personal experience, it is impossible to invite other players on Xbox to your world; You are still able to join Xbox players, but they cannot join you. This has been occurring since 1.20.40.22, and does not happen in the release version.