/clear @p[hasitem=\{quantity=!1,quantity=!2,quantity=!3,item=dirt}] dirt -1 4
when I have 1 or 2 dirt in my inventory this command is not supposed to clear the dirt from my inventory but it does.