Abstract:Meaning Representation (AMR) parsing aims to automatically translate text into a directed and acyclic semantic graph, which recently has been improved significantly by Transformer-based pre-trained models (e.g., BART and T5). However, the existing parsers still encounter errors, particularly in graph structure prediction and concept abstraction, that substantially distort text meaning. In this paper, we attempt to alleviate these issues in AMR parsing by incorporating the hierarchical structure of the input text into pre-trained models. We first present a hierarchical multi-granularity (HMG) schema to describe the hierarchical structures of the given text, containing a sentence-clause-phrase-word hierarchy. Furthermore, we propose a hierarchical multi-granularity AMR parsing framework (HMG-AMR) based on a Transformer, which explicitly integrates the HMG schema of the input text. Specifically, we introduce new inductive biases and enhance the interactions among multi-granularity representations (i.e., words, phrases, clauses and sentences) by modifying the attention mechanisms in the encoder and the decoder. We conduct extensive experiments on two public in-distribution benchmarks (i.e., AMR2.0 and AMR3.0), on three out-of-distribution benchmarks (i.e., Bio, New3, and TLP), and in several few-shot settings. The results show that HMG-AMR outperforms the solid baseline by up to 1.4% and 1.1% in terms of the Smatch scores attained on AMR2.0 and AMR3.0, respectively. In addition, HMG-AMR exhibits notable advantages in out-of-distribution and few-shot settings, showing its ability to compensate for insufficient data and adapt to diverse domains. Most notably, further analyses involving 10 linguistic probing tasks verify that incorporating the HMG schema allows the model to capture distinct linguistic properties, demonstrating the universality of the proposed framework and its potential for application in other tasks.

Exploration and Comparison of Diverse Approaches for Integrating Syntactic Knowledge into AMR Parsing

ATP: AMRize then Parse! Enhancing AMR Parsing with PseudoAMRs

Improving AMR Parsing with Sequence-to-Sequence Pre-training

A Neural Transition-Based Approach for Semantic Dependency Graph Parsing

Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing

From text to graph: a general transition-based AMR parsing using neural network

Boosting Neural Machine Translation with Dependency-Scaled Self-Attention Network.

Hierarchical information matters! Improving AMR parsing with multi-granularity representation interactions

AMRs Assemble! Learning to Ensemble with Autoregressive Models for AMR Parsing

SG-Net: Syntax-Guided Machine Reading Comprehension.

Incorporating Graph Information in Transformer-based AMR Parsing

AMR Parsing with Action-Pointer Transformer

Deps-SAN: Neural Machine Translation with Dependency-Scaled Self-Attention Network

Pushing the Limits of AMR Parsing with Self-Learning

Making Better Use of Bilingual Information for Cross-Lingual AMR Parsing.

Addressing Long-Distance Dependencies in AMR Parsing with Hierarchical Clause Annotation

Stacked AMR Parsing with Silver Data

Parsing All: Syntax and Semantics, Dependencies and Spans

Self-attentive Biaffine Dependency Parsing.

AMR Parsing as Sequence-to-Graph Transduction

Guiding transformer to generate graph structure for AMR parsing