The provisions of this chapter shall have no application to any business, store, shop or factory existing and in operation in a restricted residence district on the 22nd day of March, 1956, except in the matter of reconstruction, repair, alteration or change in use of the structure.