In case, however, of a protest against such change signed by the owners of 20% or more of the area of land included in such proposed change or of that immediately adjacent extending 100 feet therefrom or of that directly opposite thereto, extending 100 feet from the street frontage of such opposite land, such amendment shall not become effective except by the favorable vote of at least four members of the Town Board.