A nonconforming use shall not be enlarged unless the use is changed to a conforming use; provided, however, that where a building meets the use requirements of this chapter and is nonconforming because of height, area, frontage or yard regulations, said use may be enlarged, provided that the height, area, frontage or yard regulations are not further violated.