Control Over Use. No building or premises shall hereafter be used or occupied, and no building or structure, or part thereof, shall be erected, moved, reconstructed, enlarged, or altered, except in conformity with the regulations herein specified for the district in which it is located; except that in Residence Districts a lot in single ownership which was of record at the time of adoption of this ordinance, even though not meeting the requirements of this Chapter as to area and width, may be used for single-family residence purposes, provided that such use conforms with all other applicable regulations of this Chapter.