Any person who shall continue any work after having been served with a notice of violation or a stop work order, except such work as that person is directed to perform to remove or remedy a violation or unsafe condition, shall be subject to penalties as prescribed by N.J.S.A. 40:49-5 as appropriate.