A structure which, by reason of restriction on area, lot coverage, height, yards or other characteristics, could not be built under the terms of this chapter:
(1) Shall not be enlarged or altered in a way which increases its nonconformity.
(2) Shall not be reconstructed except in conformance with this chapter should such a structure be destroyed by any means to an extent of more than 50% of its replacement cost at the time of destruction.