The nonconforming structure may only be restored or reconstructed so as to have the same, but not greater, height, shape, and floor area that it had immediately prior to the damage or destruction. In addition, a nonconforming structure that is located in a historically significant area or which is a significantly important building may also only be restored or reconstructed so as to have the same appearance that it had immediately prior to the damage or destruction. The building official shall estimate the height, shape, floor area, and when applicable the appearance of the structure immediately prior to the damage or destruction, and shall consult with the property owner, if necessary, to make a determination. Should the property owner not agree with the determination of the building official, the property owner may appeal the determination of the building official to the board of adjustment, in accordance with this chapter.