A structure which is nonconforming by reason of its intrusion into any required front or side yard areas may be enlarged, provided, however, that the existing nonconforming setbacks are not further encroached upon.