Failure to comply with any condition or restriction prescribed by the Board of Appeals in approving any appeal for a variance, application for a special permit or a modification of regulations shall constitute a violation. Such violation may constitute the basis for revocation of a variance, special permit or modification, or for imposing penalties and other applicable remedies.