No existing building or premises devoted to a use not permitted by this Chapter in the district in which such building or premises is located, except when required to do so by law or ordinance, shall be enlarged, extended, reconstructed or structurally altered, unless such use is changed to one permitted in the district in which such building or premises is located.