No building shall hereafter be erected or altered to exceed the height, to accommodate or house a greater number of families or to have narrower or smaller rear yards, front yards or side yards than are specified herein for the district in which such building is located.