The Board shall decide each appeal within a reasonable time, and notice thereof shall be given to all parties in interest. The Board's decision shall be immediately filed in its office and be a public record. In the exercise of its functions upon such appeals or upon exceptions, the Board may, in conformity of the law, reverse or affirm, wholly or partly, or modify the order, requirement, decision or determination as, in its opinion, ought to be made.