In my case, a zombie could see a villager through a wall and was trying to get to the villager. So he was ignoring me, until I hit him.