It increases when I use Bottles of enchanting but not when I mine nether quartz in survival or do other things that generate XP. I recently died and recreated all of my enchanted items in creative then switched back to survival. I am not sure if this caused the issue.