Prior to making a final decision on a variance, interpretation or extension of a nonconforming use, the Zoning Board of Appeals shall fix a reasonable time for the hearing of the appeal or other matter referred to it and give public notice thereof by publication in the official paper of a notice of such hearing, at least 10 days prior to the date thereof, and shall, at least five days before such hearing, mail or hand-deliver, at the discretion of the Code Enforcement Officer, notice thereof to the parties, and shall decide the same within 60 days after the final hearing. Upon the hearing, any party may appear in person or by agent or by attorney. The Zoning Board of Appeals may reverse or affirm, wholly or partly, or may modify the order, requirement, decision, or determination appealed from as, in its opinion, ought to be made in the premises and to that end shall have all powers of the officer from whom the appeal is taken.