For the purpose of this chapter, the Village of Sag Harbor is hereby divided into six zoning districts and three overlay districts, which shall be designated as follows:

Zoning Map. The boundaries of each of said districts shall be as shown on the duly adopted Zoning Map which accompanies this chapter and which, with all notations, references and other matters shown thereon, is hereby declared a part of this chapter.

Except as otherwise herein provided, no building or land shall hereafter be used or occupied and no building or part thereof shall be erected, moved, altered, enlarged or extended unless in conformity with the regulations herein specified for the district in which it is located.