In residential zones, there shall be only one principal use of a lot. In all zones, permitted agricultural uses may be carried on in conjunction with a residential use, but in no event shall a lot contain more than one residential dwelling structure. In nonresidential zones, more than one principal use may occupy a lot or structure upon issuance of a special permit, and site plan review and approval.