Any lawful nonconforming use or structure existing at the time of the passage of this chapter may be continued upon the lot or in the building so occupied, and any such structure may be restored or repaired in the event of partial destruction thereof. The nonconforming use of a conforming or a nonconforming structure shall not be expanded, increased or enlarged. A nonconforming structure designed, arranged or devoted to a nonconforming use shall not be structurally enlarged unless the structure is changed to a conforming structure and provided the nonconforming use thereof is neither expanded, increased nor enlarged.