Abstract:The correction of grammatical errors in natural language processing is a crucial task as it aims to enhance the accuracy and intelligibility of written language. However, developing a grammatical error correction (GEC) framework for low-resource languages presents significant challenges due to the lack of available training data. This article proposes a novel GEC framework for low-resource languages, using Arabic as a case study. To generate more training data, we propose a semi-supervised confusion method called the equal distribution of synthetic errors (EDSE), which generates a wide range of parallel training data. Additionally, this article addresses two limitations of the classical seq2seq GEC model, which are unbalanced outputs due to the unidirectional decoder and exposure bias during inference. To overcome these limitations, we apply a knowledge distillation technique from neural machine translation. This method utilizes two decoders, a forward decoder right-to-left and a backward decoder left-to-right, and measures their agreement using Kullback-Leibler divergence as a regularization term. The experimental results on two benchmarks demonstrate that our proposed framework outperforms the Transformer baseline and two widely used bidirectional decoding techniques, namely asynchronous and synchronous bidirectional decoding. Furthermore, the proposed framework reported the highest F1 score, and generating synthetic data using the equal distribution technique for syntactic errors resulted in a significant improvement in performance. These findings demonstrate the effectiveness of the proposed framework for improving grammatical error correction for low-resource languages, particularly for the Arabic language.

A Framework for Indonesian Grammar Error Correction

A Simple Yet Effective Corpus Construction Framework for Indonesian Grammatical Error Correction

Dynamic decoding and dual synthetic data for automatic correction of grammar in low-resource scenario

From Spelling to Grammar: A New Framework for Chinese Grammatical Error Correction

Grammatical Error Correction: A Survey of the State of the Art

A Simple but Effective Classification Model for Grammatical Error Correction.

A Chinese Grammatical Error Correction Model Based On Grammatical Generalization And Parameter Sharing

FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction

Grammatical Error Correction for Code-Switched Sentences by Learners of English

Efficient Grammatical Error Correction Via Multi-Task Training and Optimized Training Schedule

LET: Leveraging Error Type Information for Grammatical Error Correction

A Unified Framework for Grammar Error Correction

TemplateGEC: Improving Grammatical Error Correction with Detection Template.

Pillars of Grammatical Error Correction: Comprehensive Inspection Of Contemporary Approaches In The Era of Large Language Models

Grammatical Error Correction with Neural Reinforcement Learning

Automatic Grammatical Error Correction Based on Edit Operations Information.

Detection-Correction Structure via General Language Model for Grammatical Error Correction

Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correction

Semi-supervised learning and bidirectional decoding for effective grammar correction in low-resource scenarios

A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model

Grammatical Error Correction with Dependency Distance