In interpreting and applying the provisions of this chapter, the regulations shall be held to be the minimum requirements for the promotion of the public safety, health, convenience, comfort, propriety and general welfare. It is not intended by this chapter to interfere with or abrogate or annul any easements, covenants or other agreements between parties; provided, however, that where this chapter imposes a greater restriction upon the use of buildings or premises, this chapter shall control.