Expiration of permits. No zoning permit shall be valid or effective one (1) year from the date of issuance thereof, and it shall thereafter be null and void unless the use, change or use, extension of nonconforming use, erection, construction, repair, remodeling, conversion, removal, destruction or moving, alteration, or relocation of a building or structure authorized by such permit shall have been substantially commenced within one year from the date of issuance and proceeded with due diligence.