In exercising the above mentioned powers, such Zoning Hearing Board may, in conformity with the provisions of this section, reverse or affirm, wholly or partly, or may modify the order, requirement, decision or determination appealed from and may make such order, requirement, decision or determination as in its opinion ought to be made. Notice of such decision shall forthwith be given to all parties in interest and shall be filed immediately with the Zoning Officer.