When a villager was sleeping in a bed next to me, I saw that he would completely vanish when he should still be visible. You can see it happening in the screenshots where I am only moving a couple pixels. 

This is happening in Singleplayer, Minecraft version 1.17.1 (Optifine pre-release), Java 16.0.1