A nonconforming use may be changed to another nonconforming use of the same or more restrictive classification only upon issuance of a special permit by the Zoning Board of Appeals upon finding that the proposed use will have a lesser impact on surrounding properties than the existing use. In its determination, the Zoning Board of Appeals shall consider parking demand, pedestrian and traffic volume, intensity of use, hours of activity, noise levels and any other factors considered relevant under the circumstances. When there is such a change to a more restrictive use or to another nonconforming use, there shall be no change allowed returning to the previous prior use.