It is not intended by this chapter to repeal, abrogate, annul or in any way to impair or interfere with any existing provision of law or ordinance or with any rules, regulations or permits previously adopted or issued or which shall be adopted or issued pursuant to law relating to the use of buildings or premises; nor is it intended by this chapter to interfere with or abrogate or annul any easements, covenants or other agreements between parties; provided, however, that where this chapter imposes greater restrictions upon the use of buildings or premises or upon the height of buildings, or requires larger yards, courts or other open spaces than are imposed or required by such existing provision of law or ordinance or by such rules, regulations or permits or by such easement, covenants or agreements, the provisions of this chapter shall control.