A use or a structure designed for a use which is listed as permitted in the district of its location under certain qualifying conditions contained in the use regulations of such district, such as a conditional use permitted by the Council, a special exception permitted by the Board, etc., and which exists without compliance with these conditions or a use which does not comply only because of failure to provide required automobile parking space and loading space shall have the same rights and privileges of continuance and maintenance as if it were in compliance with these conditions and requirements. This provision, however, shall not be deemed to remove the obligation to provide required automobile parking space and loading space, nor the obligation to comply with all applicable regulations of this chapter for any enlarged, changed or restored portion of the use or structure at the time of such enlargement, change or restoration.