Any use existing in any building at the time of the passage of this chapter and not conforming to the regulations of the use district in which it is maintained may be continued therein. Also, such nonconforming use may be changed to another use which is allowed in the district to which the existing nonconforming use belongs, provided that it is no more harmful in character.