Abstract:Predicting linearized Abstract Meaning Representation (AMR) graphs using pre-trained sequence-to-sequence Transformer models has recently led to large improvements on AMR parsing benchmarks. These parsers are simple and avoid explicit modeling of structure but lack desirable properties such as graph well-formedness guarantees or built-in graph-sentence alignments. In this work we explore the integration of general pre-trained sequence-to-sequence language models and a structure-aware transition-based approach. We depart from a pointer-based transition system and propose a simplified transition set, designed to better exploit pre-trained language models for structured fine-tuning. We also explore modeling the parser state within the pre-trained encoder-decoder architecture and different vocabulary strategies for the same purpose. We provide a detailed comparison with recent progress in AMR parsing and show that the proposed parser retains the desirable properties of previous transition-based approaches, while being simpler and reaching the new parsing state of the art for AMR 2.0, without the need for graph re-categorization.

Meta-Structure Transformation Model for Statistical Machine Translation.

RM-structure alignment based statistical machine translation model

Statistical Machine Translation Model with Meta-Structure Alignments

A Tree-to-tree Alignment-Based Model for Statistical Machine Translation

Subgraph based multitext grammar for statistical machine translation

Syntax Encapsulated Phrase Model for Statistical Machine Translation

Statistical Translation Model Based On Source Syntax Structure

Language Modeling for Syntax-Based Machine Translation Using Tree Substitution Grammars

Forest-based Tree Sequence to String Translation Model

Language Modeling for Syntax-Based Machine Translation Using Tree Substitution Grammars: A Case Study on Chinese-English Translation.

A SP synchronous generation model for statistical machine translation 1

A Tree Sequence Alignment-based Tree-to-Tree Translation Model.

Towards Integrated Machine Translation Using Structural Alignment From Syntax-Augmented Synchronous Parsing

A Statistical Machine Translation Model with Forest-to-Tree Algorithm for Semantic Parsing.

An Improved Hierarchical Phrase Based Machine Translation Model

Translation rules extraction for statistical machine translation

Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing

Comparative Study on Hierarchical Phrase Structures and Linguistic Phrase Structures.

A Non-Contiguous Tree Sequence Alignment-Based Model for Statistical Machine Translation

A Study of Translation Rule Classification for Syntax-Based Statistical Machine Translation

Head-modifier relation based non-lexical reordering model for phrase-based translation