Except as specifically otherwise provided herein for attached single-family dwellings, apartments, or planned development projects, only one principal residence building shall be permitted on a lot; provided, however, that the Zoning Board of Appeals may grant an exception to permit more than one principal building on a lot where such grant would not be contrary to the spirit or intent of this chapter or to the regulations applicable to the specific district, and provided that a sufficient lot area is provided and the buildings so located as to individually meet the setback, offset, lot size, density and open space requirements of the district in which located.