It is the intent of this article to permit legal nonconforming lots, structures or uses to continue until they are removed or become more conforming, but not to encourage their continuance. It is recognized that there exists within the zoning districts established by this chapter, lots, structures and uses of land which were lawful before this article was adopted which would be prohibited, regulated or restricted under its present terms. Such lots, structures and uses are declared to be incompatible with permitted lots, structures and uses in the district involved. It is the intent of the article that such nonconformities shall not be enlarged upon, expanded or extended, or be used as grounds for adding other structures or uses prohibited elsewhere in the same zoning district.