Abstract:Syntax parse trees are a method of representing sentence structure and are often used to provide models with syntax information and enhance downstream task performance. Because grammar and syntax are inherently linked, the incorporation of syntax parse trees in GEC is a natural solution. In this work, we present a method of incorporating syntax parse trees for Grammatical Error Correction (GEC). Building off a strong sequence-to-sequence Transformer baseline, we present a unified parse integration method for GEC that allows for the use of both dependency and constituency parse trees, as well as their combination - a syntactic graph. Specifically, on the sentence encoder, we propose a graph encoder that can encode dependency trees and constituent trees at the same time, yielding two representations for terminal nodes (i.e., the token of the sentence) and non-terminal nodes. We next use two cross-attentions (NT-Cross-Attention and T-Cross-Attention) to aggregate these source syntactic representations to the target side for final corrections prediction. In addition to evaluating our models on the popular CoNLL-2014 Shared Task and JFLEG GEC benchmarks, we affirm the effectiveness of our proposed method by testing both varying levels of parsing quality and exploring the use of both parsing formalisms. With further empirical exploration and analysis to identify the source of improvement, we found that rich syntax information provided clear clues for GEC; a syntactic graph composed of multiple syntactic parse trees can effectively compensate for the limited quality and insufficient error correction capability of a single syntactic parse tree.

Improved Parsing for Argument-Clusters Coordination

Improved parsing with taxonomy of conjunctions

Coordination Annotation Extension in the Penn Tree Bank

A Separately Passive-Aggressive Training Algorithm for Joint POS Tagging and Dependency Parsing

Parsing TCT with a Coarse-to-fine Approach.

Transition-based Bubble Parsing: Improvements on Coordination Structure Prediction

Automatic Prediction of the Performance of Every Parser

Parsing Penn Chinese treebank (CTB) with head-driven model

Improving Feature-Rich Transition-Based Constituent Parsing Using Recurrent Neural Networks.

Resolving Coordinate Structures for Chinese Constituent Parsing.

Parsing TCT with Split Conjunction Categories.

High-order Joint Constituency and Dependency Parsing

Multiple TreeBanks Integration for Chinese Phrase Structure Grammar Parsing Using Bagging.

Analysis of the Penn Korean Universal Dependency Treebank (PKT-UD): Manual Revision to Build Robust Parsing Model in Korean

Parsing Penn Chinese Treebank Based on Lexicalized Model

Incorporating rich syntax information in Grammatical Error Correction

HC-search for Incremental Parsing

Statistical Decision-Tree Models for Parsing

Dependency Parsing with Partial Annotations: an Empirical Comparison.

K-Best Combination of Syntactic Parsers.

Context-Aware Parse Trees