Any variance from the terms of this chapter hereafter granted by the Board of Adjustment permitting the erection or alteration of any structure or structures, or permitting a specified use of any premises shall expire by limitation unless such construction or alteration shall have been actually commenced on each and every structure permitted by the variance, or unless such permitted use has actually been commenced within nine months from the date of entry of the judgment or determination of the Board of Adjustment; except however, that the running of the period of limitation herein provided shall be tolled from the date of filing an appeal from the decision of the Board of Adjustment to the Governing Body, or to a court of competent jurisdiction, until the termination in any manner of such appeal or proceeding.