After hitting something with a sword, there is a short time before you can deal damage to it again with the sword, but if you click to deal damage to the object before the time is up, then durability is taken away from your sword even though you did not deal any damage.