If you swap to another item in your inventory it can sometimes not swap and the item you were previously holding stays in your hand. It may have something to do with the replaceitem command because I was using this at the time.