No building or structure in any district shall be erected, enlarged or structurally altered without a Building Permit duly issued, upon application, by the Enforcing Officer. No Building Permit shall be issued by the Enforcing Officer except in conformance with the provisions of this chapter or unless he is directed to issue same under written order from the Zoning Board of Adjustment in the form of a variance special permit or administrative review as provided by this chapter.