Any nonconforming building, structure, or use, as defined herein, which lawfully existed at the time of passage of the applicable provision of this or any prior bylaw or any amendment thereto may be continued, subject to the provisions of this bylaw. Any lawfully nonconforming building or structure and any lawfully nonconforming use of building or land may be continued in the same kind and manner and to the same extent as at the time it became lawfully nonconforming, but such building or use shall not at any time be changed, extended or enlarged except for a purpose permitted in the zoning district in which such building or use is situated, or except as may be permitted by a special permit or otherwise by the North Andover Board of Appeals. Preexisting nonconforming structures or uses, however, may be extended or altered, provided that no such extension or alteration shall be permitted unless there is a finding by the Board of Appeals that such change, extension, or alteration shall not be substantially more detrimental than the existing nonconforming use to the neighborhood. When a preexisting structure has been made nonconforming due to changes in the lot size required by this bylaw, such structure may be extended or altered based on a finding by the Zoning Enforcement Officer that such structure after the change meets all current zoning requirements except for lot size.