To hear and decide, on a de novo basis, where it is alleged by an aggrieved party that there is an error in any order, requirement, decision or determination made by, or failure to act by, the Code Enforcement Officer in his or her review of and action on a permit application under this chapter. The action of the Code Enforcement Officer may be modified or reversed by the Zoning Board of Appeals by a majority vote. Any notice of violation, or any order, requirement, decision or determination made, or failure to act, in the enforcement of this chapter is not appealable to the Zoning Board of Appeals. Such enforcement actions are appealable only to the courts as allowable by law and rules of civil procedure.