An existing building designed and used for a conforming use but located on a nonconforming lot, whether the building is conforming or nonconforming with respect to lot coverage and minimum yard requirements, may be reconstructed, structurally altered, restored or repaired in whole or in part, except that the degree of nonconformity shall not be increased.