When any accessory building or structure, other than a subterranean air-raid or fallout shelter, is attached to or constructed as a part of the main building to which it is accessory, it shall be subject to the yard requirements of the main building.