Villagers dont take a job from the nearest workplace, they can take a job from the whole village

(from the far distance and almost instant)

And for some reason one of them just lost his job(I didnt break any workplace in this village)