I don't know when but my villagers always dissapear when i'm not on that room firstly i summon a iron golem to defend them but it shown that they are always dissapearing. It happen 3 times already and every time only 4 villagers remain.