Following public notice and hearing, the Board may reverse or affirm, wholly or partly, or may modify the order, requirement, decision or determination as, in its opinion, ought to be made in the premises and to that end shall have all the power of the Building Inspector. If the action by the Board is to reverse the action of the Building Inspector in whole, the filing fee shall be refunded to the applicant. The Board shall decide the same within 62 days following the final hearing.