The planning board shall be reasonable in its consideration of plans for alterations, additions, or demolition of structures, (located within the historic district) which have little historic or architectural significance unless such alterations, additions, or demolition would seriously impair the visual character of the surrounding area.