Any premises used or building hereinafter erected, moved or structurally altered or any use hereinafter established in violation of the provisions of this chapter by any person, firm, association, corporation (including building contractors or his or their agent) shall be deemed an unlawful structure or use. The Town Board may direct the Town Attorney to bring an action to enjoin, remove or vacate any use, erection, moving or structural alteration of any building or use in violation of this chapter. Unless otherwise stated in this chapter, any person who violates this chapter shall forfeit not less than $75 together with taxable costs in such action and not more than $500 for each violation. Each day of violation shall constitute a separate offense.