A nonconforming structure other than a single-family residential or farm structure which is damaged or destroyed, to the extent of more than 75% of its then existing fair market value, may not be rebuilt, except in conformity with the requirements of this chapter.