A nonconforming lot shall not be further reduced in size. In any district in which single-family dwellings are permitted, a single-family dwelling and customary accessory structures may be erected on any single lot of record at the effective date of this chapter. This provision shall apply even though such lot fails to meet the requirements for area or width, or both, applicable to the district.