Minimum front yard setbacks shall be 20 feet, except that where an existing building is being replaced, the new setback is not required to be larger, and where the lot is adjoined by a building or buildings with a lesser setback, such lesser existing setback shall apply.