No building shall be erected, converted, reconstructed or structurally altered so as to intrude upon the area required for the front, side and rear yards as herein established; provided further that no yard or open space on adjoining property shall be considered as providing a yard or open space for a lot wherever a building is to be erected.