The provision regarding nonconformity shall apply only to a use, building or structure legally established or erected, but not to any use established or building or structure erected in violation of law, regardless of the time of establishment or erection.