Abstract: Recent studies have revealed that grammatical error correction methods in the sequence-to-sequence paradigm are vulnerable to adversarial attack, and simply utilizing adversarial examples in the pre-training or post-training process can significantly enhance the robustness of GEC models to certain types of attack without suffering too much performance loss on clean data. In this paper, we further conduct a thorough robustness evaluation of cutting-edge GEC methods for four different types of adversarial attacks and propose a simple yet very effective Cycle Self-Augmenting (CSA) method accordingly. By leveraging the augmenting data from the GEC models themselves in the post-training process and introducing regularization data for cycle training, our proposed method can effectively improve the model robustness of well-trained GEC models with only a few more training epochs as an extra cost. More concretely, further training on the regularization data can prevent the GEC models from over-fitting on easy-to-learn samples and thus can improve the generalization capability and robustness towards unseen data (adversarial noise/samples). Meanwhile, the self-augmented data can provide more high-quality pseudo pairs to improve model performance on the original testing data. Experiments on four benchmark datasets and seven strong models indicate that our proposed training method can significantly enhance the robustness of four types of attacks without using purposely built adversarial examples in training. Evaluation results on clean data further confirm that our proposed CSA method significantly improves the performance of four baselines and yields nearly comparable results with other state-of-the-art models. Our code is available at https://github.com/ZetangForward/CSA-GEC.

Leveraging Adversarial Training to Facilitate Grammatical Error Correction

Improving Grammatical Error Correction Models with Purpose-Built Adversarial Examples

Beyond Hard Samples: Robust and Effective Grammatical Error Correction with Cycle Self-Augmenting.

Adversarial Grammatical Error Correction

Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedule

Improving Grammatical Error Correction with Data Augmentation by Editing Latent Representation

Grammatical Error Correction: More Data with More Context

TransGEC: Improving Grammatical Error Correction with Translationese

A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model

Online Self-boost Learning for Chinese Grammatical Error Correction

Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correction

MixEdit: Revisiting Data Augmentation and Beyond for Grammatical Error Correction

A Simple Recipe for Multilingual Grammatical Error Correction

Improving Grammatical Error Correction via Contextual Data Augmentation

Optimizing the Impact of Data Augmentation for Low-Resource Grammatical Error Correction.

Grammatical Error Correction via Mixed-Grained Weighted Training

Spoken Language ‘grammatical Error Correction’

Incorporating Constituent Syntax into Grammatical Error Correction with Multi-Task Learning

Type-Driven Multi-Turn Corrections for Grammatical Error Correction

Toward Perfect Neural Cascading Architecture for Grammatical Error Correction

Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Models