A nonconforming building, structure, sign, or parcel of land or the use thereof, which exists by virtue of a variance or a special use permit (or a special exception) granted by the permitting authority, shall not be considered a nonconformance for the purposes of this section, and shall not acquire the rights of this section. Rather, such building, structure, sign, parcel of land, or use thereof, shall be considered a use by variance or a use by special use permit and any moving, addition, enlargement, expansion, intensification or change of such building, structure, sign, parcel of land or use thereof, to any use other than a permitted use or other than in complete conformance with this chapter, shall require a further variance or special use permit from the permitting authority.