At sunset adult villagers head home and sleep in bed, meanwhile baby villagers seem to have problem getting into doors and wander around for a while. When a baby villager try to open a door it closes right after so can't enter and then search for other houses. So player should open the door or push them to successfully get inside.