The provisions of this chapter shall not apply to prevent the erection of a parapet wall or cornice for ornament extending above the height limits of this chapter by not more than five feet. Public and quasi-public buildings, schools, churches and other similar permitted uses shall increase the front, rear and side yards by one foot for each foot by which such buildings exceed the height limit herein established for such zone in which it is located.