Nothing in this article shall require any change in the plans, construction, size or designated use of any building, structure or part thereof for which any building permit has been granted before May 1, 1979, provided that construction from such plans shall have been started within 60 days after May 1, 1979, and shall be diligently pursued to completion.