The Building Inspector shall serve a notice of violation and order to any owner or person responsible for the erection, construction, reconstruction, completion, conversion, or alteration of a structure or change in use, increase in intensity of use or extension or displacement of use of any structure or lot in violation of a permit or certificate issued under the provisions of this chapter, or in violation of any provision of this chapter, and such order shall direct the discontinuance of the unlawful action, use or condition and the abatement of the violation within a time to be specified by the Building Inspector. Any owner who, having been served with a notice, ceases any work or other activity, or who fails to complete the structure, shall not leave any structure or lot in such conditions as to be a hazard or menace to the public safety, health, morals or general welfare.