If a building permit is denied, the Construction Official shall promptly cause to be sent to the applicant, addressed to the address of the applicant set forth in the application for the said permit, a notice of his action, which shall specify, in writing, the ground or grounds upon which the same is based. The applicant may, within five days thereafter, notify the Construction Official in writing that he appeals from such determination of the Construction Official to the Board of Adjustment, hereinafter provided for, and it shall thereupon be the duty of the Construction Official to deliver the plans, specifications, application for permit, certificate of use or intended use of such buildings or proposed building and a copy of his notification to the owner or to his agent that such building or use is a nonconforming building or use, or both, together with any other papers or information in his possession to the Board of Adjustment, and the Board of Adjustment shall, within 30 days thereafter and upon five days' notice in writing to the said owner or his agent, review the determination of the Construction Official and either affirm or reverse the determination of the Construction Official.