Permits previously issued. Nothing herein contained shall require any change in the plans, construction, size or designated use of any building, structure, or part thereof for which a building permit has been granted before this chapter becomes effective.