Unless otherwise specified by the Board of Adjustment, a decision on any appeal for a variance or application for a special permit shall expire without further notice if the applicant fails to obtain any necessary building permit or to comply with the conditions of an authorized permit within one year from the date of such decision.