No sandpit or gravel pit shall be operated and maintained, and no topsoil shall be removed from any premises, and no land or other premises shall be used for any excavation or for the removal of sand, gravel, stone, topsoil or other minerals therefrom, except where a currently effective special use permit shall have been issued by the Zoning Board of Appeals in conformance with the requirements of this article or where such operation is listed as exemption in § 198-79. The Zoning Board of Appeals shall in no case issue any such permit for land in any district other than a General Industry District.