The lawful use of a building existing at the time of the passage of this Chapter may be continued, although such use does not conform to the provisions thereof, and such use may be extended throughout the building provided no structural alterations, except those required by law or ordinance, are made therein. If no structural alterations are made, a non-conforming use of a building may be changed to another non-conforming use of the same or more restricted classification. Whenever the non-conforming use of a building has been changed to a more restricted use or to a conforming use, such use shall not thereafter be changed to a less restricted use. In the event that the non-conforming use of a building is discontinued for a period of one (1) year, the use of same shall thereafter conform to the regulations of the district in which it is located.