Nothing in this ordinance shall prevent the restoration or continuance of a non-conforming building or structure which is non-conforming because of its use and which is partially destroyed by fire, explosion, act of God, or of any public enemy, or the like, if the extent of the destruction be not more than 50% of either the true value or cubical contents of the whole building or structure at the time of the partial destruction, provided that all required repairs or restoration shall be commenced within two years after the damages occur and shall be completed within four years of such date of the damage occurring. Failure to comply within these time limits shall require the rebuilding and use to be conforming in all respects. If, however, any such building or structure shall be destroyed in the manner aforesaid to an extent exceeding 50% of either the true value or cubical contents of the whole building or structure at the time of such destruction, then the same may only be reconstructed and thereafter used in such a manner as to conform to all the requirements, terms and conditions of this ordinance.