Prior to making a final decision on a variance, interpretation or extension of a nonconforming use, the Zoning Board of Appeals shall fix a reasonable time for the hearing of the appeal or other matter referred to it and give public notice thereof by the publication in the official paper of a notice of such hearing, at least 10 days prior to the date thereof, and shall, at least five days before such hearing, mail or hand deliver, at the discretion of the Code Enforcement Officer, notices thereof to the parties and shall decide the same within 60 days after the final hearing. Upon the hearing, any party may appear in person or by agent or by attorney. The Zoning Board of Appeals may reverse or affirm, wholly or partly, or may modify the order, requirement, decision, or determination appealed from as in its opinion ought to be made in the premises and to that end shall have all powers of the officer from whom the appeal is taken.