Notwithstanding any provision to the contrary contained in this chapter, preexisting nonconforming single-family residential structures within the RW B District may remain and may be enlarged and/or altered as long as such enlargement or alteration can be accomplished within the established setbacks for the district.