In the zones governed by this ordinance, a nonconforming single family dwelling that having damage of less than 50 percent may be altered and repaired, but not enlarged or extended, during the term of this ordinance, unless said dwelling is changed to a single family dwelling conforming to the requirements of this chapter.