No building shall hereafter be used, erected, altered, converted, enlarged, added to, moved or reduced, wholly or in part, nor shall any lands be designed, used or physically altered for any purpose or in any manner except in conformity with this chapter.