Neighborhood opposition is brewing over a housing plan for the vacant Sioux Trail Elementary School site in Burnsville.