No new building, new sign, or other new structure or part thereof shall be placed between the setback lines established by this chapter and the highway except as provided by this chapter, and no building, sign, or structure or part thereof existing within such setback lines on the effective date of this chapter shall be altered, enlarged, or added to in any way that increases or prolongs the permanency thereof, or be reconstructed in its original existing location after having been destroyed by fire, storm, or other catastrophe to the extent of 50% or more of its last equalized value, except that an existing building, sign or structure which is damaged or destroyed by violent wind, vandalism, fire, flood, ice, snow, mold or infestation may be restored in accordance with the provisions of § 62.23(7)(hc), Wis. Stats.