Abstract:We study neural data-to-text generation. Specifically, we consider a target entity that is associated with a set of attributes. We aim to generate a sentence to describe the target entity. Previous studies use encoder-decoder frameworks where the encoder treats the input as a linear sequence and uses LSTM to encode the sequence. However, linearizing a set of attributes may not yield the proper order of the attributes, and hence leads the encoder to produce an improper context to generate a description. To handle disordered input, recent studies propose two-stage neural models that use pointer networks to generate a content-plan (i.e., content-planner) and use the content-plan as input for an encoder-decoder model (i.e., text generator). However, in two-stage models, the content-planner may yield an incomplete content-plan, due to missing one or more salient attributes in the generated content-plan. This will in turn cause the text generator to generate an incomplete description. To address these problems, we propose a novel attention model that exploits content-plan to highlight salient attributes in a proper order. The challenge of integrating a content-plan in the attention model of an encoder-decoder framework is to align the content-plan and the generated description. We handle this problem by devising a coverage mechanism to track the extent to which the content-plan is exposed in the previous decoding time-step, and hence it helps our proposed attention model select the attributes to be mentioned in the description in a proper order. Experimental results show that our model outperforms state-of-the-art baselines by up to 3% and 5% in terms of BLEU score on two real-world datasets, respectively.

TransCP: A Transformer Pointer Network for Generic Entity Description Generation with Explicit Content-Planning

Sentence Generation for Entity Description with Content-Plan Attention.

GCP: Graph Encoder with Content-Planning for Sentence Generation from Knowledge Base

GCP: Graph Encoder with Content-Planning for Sentence Generation from Knowledge Bases.

Grouped-Attention for Content-Selection and Content-Plan Generation.

Neural data-to-text generation with dynamic content planning

Enhancing Content Planning for Table-to-Text Generation with Data Understanding and Verification

Plan, Attend, Generate: Character-level Neural Machine Translation with Planning in the Decoder

Reach the Remote Neighbors: Dual-Encoding Transformer for Graphs

CopyFormer: A Transformer Text Generation model combined with Pointer Network.

Paraphrase Generation Model Integrating Transformer Architecture, Part-of-Speech Features, and Pointer Generator Network

R2D2: Relational Text Decoding with Transformers

CPA: Camera-pose-awareness Diffusion Transformer for Video Generation

Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Framework

Order-Planning Neural Text Generation from Structured Data

A Combined Encoder and Transformer Approach for Coherent and High-Quality Text Generation

TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual Grounding

Progressive Tree-Structured Prototype Network for End-to-End Image Captioning

Pix2Planning: End-to-End Planning by Vision-language Model for Autonomous Driving on Carla Simulator

Enhancing Text Representations Separately with Entity Descriptions

Controllable Neural Dialogue Summarization with Personal Named Entity Planning