Any person who wishes to park, stop or permit a roll-off container, dumpster, or other container on any public street or sidewalk, or on any private property, must first obtain a permit therefor from the Zoning Office. The fee for said permit for each container shall be a nonrefundable fee of $30 for the first 90 days. The roll-off container, dumpster or other container must be removed from site at the end of this period, unless otherwise approved by the Zoning Office, in its sole discretion, and the payment of a new permit fee.