A non-accessory directional sign, designating the route to an establishment not on a state highway, may be erected and maintained in any district on special permit from the Board of Appeals, subject to their finding that such sign will promote the public interest, will not endanger the public safety, and will be of such size, location and design as will not be detrimental to the neighborhood.