A nonconforming building may be remodeled but not enlarged or extended, unless said building is changed to a building conforming or more nearly conforming to the requirements of this chapter, except that single family residences in residential zones may be enlarged, providing that the enlargement conforms in every respect to this zoning chapter. New conforming single-family dwellings shall be permitted as long as all of the requirements of Subsection 23-3.4A, Schedule of Yard, Lot and Building Regulations, are met for the zone in which they are located.