In a one-family residential zone, no building or premises shall be used, and no building or part of a building shall be erected or altered, which is arranged, intended or designed to be used, in whole or in part, for any uses except single-family detached dwelling units, not to exceed one (1) such dwelling unit on each lot.