In exercising the above-mentioned powers and duties, the Board of Appeals may reverse or affirm, wholly or partly, or may modify the order, requirement, decision or determination appealed from and may make such order, decision or determination as ought to be made, and to that end have all the powers of the Permit Administrator from whom the appeal is made.