A nonconforming use on the premises in existence at the time of the passage of this chapter[1] shall not be expanded, increased or enlarged and shall not be permitted to be changed to any use other than a conforming use.