Within the districts established by this chapter or amendments that may later be adopted, there exist lots, structures, and uses of land and structures which were lawful before the Zoning Ordinance was adopted or amended but which would be prohibited, regulated, or restricted under the terms of this chapter or future amendment. Subject to Section 165.07, it is the intent of this chapter to permit these nonconformities to continue until they are removed, but not to encourage their survival. Such uses are declared by this chapter to be incompatible with permitted uses in the districts involved. It is further the intent of this chapter that nonconformities shall not be enlarged upon, expanded, or extended, or used as grounds for adding other structures or uses prohibited elsewhere in the same district.