Abstract:Text generation from abstract meaning representation is a fundamental task in natural language generation. An interesting challenge is that distant context could influence the surface realization for each node. In the previous encoder-decoder based approaches, graph neural networks have been commonly used to encode abstract meaning representation graphs and exhibited superior performance over the sequence and tree encoders. However, most of them cannot stack numerous layers, thus being too shallow to capture distant context. In this paper, we propose solutions from three aspects. Firstly, we introduce a Transformer based graph encoder to embed abstract meaning representation graphs. This encoder can stack more layers to encode larger context, while without performance degrading. Secondly, we expand the receptive field of each node, i.e. building direct connections between node pairs, to capture the information of its distant neighbors. We also exploit relative position embedding to make the model aware of the original hierarchy of graphs. Thirdly, we encode the linearized version of abstract meaning representation with the pre-trained language model to get the sequence encoding and incorporate it into graph encoding to enrich features. We conduct experiments on LDC2015E86 and LDC2017T10. Experimental results demonstrate that our method outperforms previous strong baselines. Especially, we investigate the performance of our model on large graphs, finding a larger performance gain. Our best model achieves 31.99 of BLEU and 37.02 of METEOR on LDC2015E86, 34.21 of BLEU, and 39.26 of METEOR on LDC2017T10, which are new states of the art.

Enhancing AMR-to-Text Generation with Dual Graph Representations

Better AMR-To-Text Generation with Graph Structure Reconstruction.

AMR-to-Text Generation with Graph Structure Reconstruction and Coverage Mechanism

AMR-To-Text Generation with Graph Transformer.

Line Graph Enhanced Amr-To-Text Generation With Mix-Order Graph Attention Networks

Enriched Entity Representation of Knowledge Graph for Text Generation

Neural amr: Sequence-to-sequence models for parsing and generation

Neural Text Generation from Rich Semantic Representations

Distant context aware text generation from abstract meaning representation

Modeling Graph Structure in Transformer for Better AMR-to-Text Generation.

Guiding transformer to generate graph structure for AMR parsing

Latent Tree Decomposition Parsers for AMR-to-Text Generation

Graph Transformer for Graph-to-Sequence Learning

Triples-to-Text Generation with Reinforcement Learning Based Graph-augmented Neural Networks

From text to graph: a general transition-based AMR parsing using neural network

Graph-based Multi-hop Reasoning for Long Text Generation.

Controlling Topic-Focus Articulation in Meaning-to-Text Generation using Graph Neural Networks

GPT-too: A language-model-first approach for AMR-to-text generation

Unleashing the Power of Language Models in Text-Attributed Graph.

Unleashing the Power of Language Models in Text-Attributed Graph

R2D2: Relational Text Decoding with Transformers