All buildings or structures hereinafter erected, constructed, reconstructed, altered, enlarged, or modified, and the use of all premises in the Town, shall be in conformity with the provisions of this By-law. No building, structure, or land shall be used for any purpose or in any manner other than as expressly permitted within the district in which such building, structure, or land is located. Where the application of this By-law imposes greater restrictions than those imposed by any other regulations, permits, restrictions, easements, covenants, or agreements, the provisions of this By-law shall control.