When ever you go and find a new generated pillager outpost, you can't find much pillager's outside the outpost but inside. then once the pillager's go outside, a lot of them will stand right next the the outpost (literally) and then path find back to the first floor of the outpost and it repeats. Notice in the picture, the pillager's are staying inside the outpost rather then spreading around the outpost.