If the construction is not in compliance with conditions placed on said permit, the permit shall be revoked by the Director of Planning and Development, at any time prior to the completion of the building or structure for which the same was issued, when it shall appear that there is departure from the plans, specifications or conditions as required under terms of the permit, that the same was procured by false representation, or was issued by mistake, or that any of the provisions of the Zoning Ordinance are being violated. Upon the failure, refusal, or neglect of any owner, his/her agent, contractor or duly authorized representative to secure such permit and pay the prescribed fee, the Building Inspector may issue a stop order; and thereafter no such construction shall proceed.