Abstract:Syntax parse trees are a method of representing sentence structure and are often used to provide models with syntax information and enhance downstream task performance. Because grammar and syntax are inherently linked, the incorporation of syntax parse trees in GEC is a natural solution. In this work, we present a method of incorporating syntax parse trees for Grammatical Error Correction (GEC). Building off a strong sequence-to-sequence Transformer baseline, we present a unified parse integration method for GEC that allows for the use of both dependency and constituency parse trees, as well as their combination - a syntactic graph. Specifically, on the sentence encoder, we propose a graph encoder that can encode dependency trees and constituent trees at the same time, yielding two representations for terminal nodes (i.e., the token of the sentence) and non-terminal nodes. We next use two cross-attentions (NT-Cross-Attention and T-Cross-Attention) to aggregate these source syntactic representations to the target side for final corrections prediction. In addition to evaluating our models on the popular CoNLL-2014 Shared Task and JFLEG GEC benchmarks, we affirm the effectiveness of our proposed method by testing both varying levels of parsing quality and exploring the use of both parsing formalisms. With further empirical exploration and analysis to identify the source of improvement, we found that rich syntax information provided clear clues for GEC; a syntactic graph composed of multiple syntactic parse trees can effectively compensate for the limited quality and insufficient error correction capability of a single syntactic parse tree.

Grammatical Error Correction with Dependency Distance

A Syntax-Guided Grammatical Error Correction Model with Dependency Tree Correction

Grammatical Error Correction: More Data with More Context

Incorporating Constituent Syntax into Grammatical Error Correction with Multi-Task Learning

Leveraging Denoised Abstract Meaning Representation for Grammatical Error Correction

Automatic Grammatical Error Correction Based on Edit Operations Information.

Adversarial Grammatical Error Correction

Grammatical Error Correction Based on Corpus

GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding

SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parser

Grammatical Error Correction: A Survey of the State of the Art

Detection-Correction Structure via General Language Model for Grammatical Error Correction

Weakly Supervised Grammatical Error Correction using Iterative Decoding

Combining GCN and Transformer for Chinese Grammatical Error Detection

Corpus and Unsupervised Benchmark: Towards Tagalog Grammatical Error Correction

Toward Perfect Neural Cascading Architecture for Grammatical Error Correction

Grammatical Error Correction via Mixed-Grained Weighted Training

TransGEC: Improving Grammatical Error Correction with Translationese

Diversity-Driven Combination for Grammatical Error Correction

A BERT-based Unsupervised Grammatical Error Correction Framework

Incorporating rich syntax information in Grammatical Error Correction