A use, building or structure existing at the time of the adoption of this chapter or amended thereto or supplement thereof, although such use or structure does not conform to the provisions thereof, may be continued except as otherwise provided in this section.