Nothing in these bylaws shall require any change in the plans construction, size or designated use of any building, structure or part thereof for which a building permit has been legally granted before the enactment of these bylaws, and the construction of which from such plans date of enactment, except that if the building operation in question is discontinued for a period of six months, any further construction shall be in conformity with the provisions of these bylaws.