Any building or use of a building or use of land or part thereof lawful at the time this chapter is adopted (1939) may be continued, unless and until abandoned, although such building or use does not conform to the provisions hereof. No extension of the nonconforming use of a building, including adding to, enlarging, reconstructing or replacing, shall be allowed unless such addition, enlargement, reconstruction or replacement is used for the purpose or for a purpose substantially similar to the purpose for which the original building may be lawfully used and unless authorized by the Board of Appeals and subject to appropriate conditions, limitations or safeguards stated in writing by said Board and made a part of the permit. As a basis for such permit, the Board must be satisfied only that such addition, enlargement, reconstruction or replacement, and the use to be made thereof, will not substantially increase any detrimental or injurious effect of the building or use on the neighborhood.