The Board of Aldermen may, by special permit, at any Board of Adjustment meeting where same has been placed on the agenda and notice has been given as required by law, subject to such protective restrictions that it deems necessary, authorize the location, construction, extension or structural alteration of any building or uses, or increase in their height, in any district from which they are prohibited or limited by this Chapter.