If no structural alterations are made, a nonconforming use of a structure or structure and premises may be changed to another nonconforming use by special permit, provided that the Board, by general rule or by making findings in the specific case, shall find that the proposed use is no less appropriate to the district than the existing nonconforming use. When such change is permitted, the Board may require appropriate conditions and safeguards in accordance with the provisions of this chapter.