The Board of Appeals, after due notice and public hearing pursuant to law, may decide any referred matter, may reverse or affirm or modify the order, requirement, decision or determination appealed from and shall make such order, requirement, decision or determination as in its opinion ought to be made and to that end shall have all the powers of the Building Inspector or other administrative official from whose order, requirement, decision, interpretation or determination the appeal is taken.