No fence, wall or structure in the nature of a fence shall be hereafter erected, constructed or maintained on any premises without a building permit. For the purpose of this subsection, a fence shall include, but not be limited to, a wall, pier or other structure constructed in the nature of a fence. A fence shall not exceed 6 1/2 feet in height with its gate height not to exceed two feet above the fence height, measured from the curb level or existing natural grade, whichever is higher, unless otherwise permitted by the Zoning Board of Appeals upon application. A fence shall be of the material and design compatible with the surrounding adjoining properties, installed with the finished side facing out towards the property boundary lines, with post and rails having the same color. Whenever possible, fence posts shall be constructed on the interior side of the fence unless the fence has two finished sides or is a post and rail style. The Building Inspector may require that an applicant for a fence permit submit a current property survey, an affidavit of the owner that the fence will be installed on his property, and evidence that the applicant has notified all adjacent landowners by certified mail, return receipt requested, of the permit application.