For any proposed alteration, reconstruction, extension or structural change other than as provided under Subsection A above, application shall be made to the Board of Appeals for a determination whether such alteration, reconstruction, extension, or structural change will increase the nonconforming nature of said structure. If the Board of Appeals finds that such alteration, reconstruction, extension, or structural change will not increase the nonconforming nature of said structure, the property owner may apply for a building permit and no special permit will be required. In the event that the Board of Appeals determines that such alteration, reconstruction, extension, or structural change will increase the nonconforming nature of said structure, the Board of Appeals may grant a special permit only if it determines that the proposed modification(s) will not be substantially more detrimental than the existing nonconforming structure to the neighborhood.