To hear and decide appeals from and review any order, requirement, decision or determination of any administrative official charged with enforcement of this chapter. The Board of Appeals shall not hear any appeal from, nor review any order, determination, requirement, decision or revocation of, the Building Inspector where such order, determination, requirement, decision or revocation has been directed by the Town Board.