The application of the penalty[1] shall not be held to prevent the enforced removal of the prohibited conditions.

Upon his becoming aware of any violation of any of the provisions of this chapter, the administrative officer shall serve notice of such violation on the person, firm or corporation committing or permitting the same, and if such violation has not ceased within such reasonable time as the administrative officer has specified in such notice and a new certificate of occupancy obtained as provided in Article XII of this text, he shall institute such action as may be necessary to terminate the violation.