Construction in progress. No building or structure designed or intended to be utilized for a nonconforming use shall be constructed or allowed. However, to avoid undue hardship, if actual construction was begun lawfully prior to the effective date of this chapter, or amendment thereto, of a structure or use made nonconforming by this chapter or amendment, a change in plans or use shall not be required, provided construction shall be pursued diligently and completed within 12 months from the date of enactment or amendment of this chapter. ("Actual construction" shall mean the placing of construction materials in permanent position and fastened in a permanent manner. Further, demolition of an existing building which has been substantially begun in preparation for building shall be deemed actual construction, provided that such work shall be diligently carried out and completed.)