Pillager Outposts in all biomes contain a large amount of wood. In Desert Biomes, wood is scarcer than gold. Consider making Pillager Outposts more Biome specific and using building materials and resources that are typical for the Desert Biome. (You have to ask where the Pillagers got all those birch logs from!) Similar issue with Mineshafts though that is less significant as Mineshafts are harder to find/exploit and probably more dangerous.

This has a really big balance impact on Desert Survival that was probably not anticipated?