Any lawful structures, building or use of a building or premises or part thereof at the time this chapter or any amendment thereto is adopted may be continued although such structure, building or use does not conform to the provisions thereof, provided that such structure or building has not been abandoned or such use discontinued for a period of 2 years or more.