Have created a 20 block radius cylinder building, 30 blocks high, walls created with stone and glass walls.  The cylinder building is fully enclosed with a glass block ceiling and a dirt floor and one wood door, yet phantoms will still spawn inside the building.