Such conversion, enlargement or expansion shall not be substantially more detrimental than the existing nonconforming structure or use to the neighborhood. For the purpose of this section, substantially more detrimental structures or uses include those which would cause readily observable difference in patronage, service, appearance, vehicular traffic, noise, employment or similar characteristics from the existing nonconforming structure or use or from any permitted structure or use in the district affected.