Nothing in this chapter shall prevent the restoration or continuance of a nonconforming building or structure which is nonconforming because of its use and which is partially destroyed by fire, explosion, act of God or of any public enemy, voluntary or negligent demolition or the like, if the extent of the destruction be not more than 50% of the fair market value of the whole building or structure at the time of the partial destruction. If, however, any such building or structure shall be destroyed in the manner aforesaid to an extent exceeding such destruction, then the same may be reconstructed, and thereafter used, only in such manner as to conform to all the requirements, terms and conditions of this chapter.