If such structure is destroyed or damaged to an extent of less than 50% of its replacement cost at the time of destruction it may be reconstructed, provided that any reconstruction shall substantially reflect the prior structural arrangement and shall not increase the degree of nonconformity. If such structure is destroyed or damaged to an extent of more than 50% of its replacement cost at the time of destruction, any reconstruction shall require approval by the Planning Commission. For the purpose of this subsection, damages shall be determined by the Building Inspector within 21 days. A nonconforming structure or any structure with a nonconforming use which is damaged or destroyed by violent wind, vandalism, fire, flood, ice, snow, mold or infestation may be restored in accordance with the provisions of § 62.23(7)(hc), Wis. Stats.