Abstract:We study neural data-to-text generation. Specifically, we consider a target entity that is associated with a set of attributes. We aim to generate a sentence to describe the target entity. Previous studies use encoder-decoder frameworks where the encoder treats the input as a linear sequence and uses LSTM to encode the sequence. However, linearizing a set of attributes may not yield the proper order of the attributes, and hence leads the encoder to produce an improper context to generate a description. To handle disordered input, recent studies propose two-stage neural models that use pointer networks to generate a content-plan (i.e., content-planner) and use the content-plan as input for an encoder-decoder model (i.e., text generator). However, in two-stage models, the content-planner may yield an incomplete content-plan, due to missing one or more salient attributes in the generated content-plan. This will in turn cause the text generator to generate an incomplete description. To address these problems, we propose a novel attention model that exploits content-plan to highlight salient attributes in a proper order. The challenge of integrating a content-plan in the attention model of an encoder-decoder framework is to align the content-plan and the generated description. We handle this problem by devising a coverage mechanism to track the extent to which the content-plan is exposed in the previous decoding time-step, and hence it helps our proposed attention model select the attributes to be mentioned in the description in a proper order. Experimental results show that our model outperforms state-of-the-art baselines by up to 3% and 5% in terms of BLEU score on two real-world datasets, respectively.

Enhancing Content Planning for Table-to-Text Generation with Data Understanding and Verification

Neural data-to-text generation with dynamic content planning

Order-Planning Neural Text Generation from Structured Data

Towards Table-to-Text Generation with Pretrained Language Model: A Table Structure Understanding and Text Deliberating Approach

Table-To-Text Generation Via Row-Aware Hierarchical Encoder

Grouped-Attention for Content-Selection and Content-Plan Generation.

Table-to-Text Generation with Effective Hierarchical Encoder on Three Dimensions (Row, Column and Time)

TransCP: A Transformer Pointer Network for Generic Entity Description Generation with Explicit Content-Planning

Plug-and-Play Recipe Generation with Content Planning

Content-Based Table Retrieval for Web Queries

Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generation

Refining Data for Text Generation.

Sentence Generation for Entity Description with Content-Plan Attention.

Data-to-text Generation with Entity Modeling

TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching

A Table-to-Text Framework with Heterogeneous Multidominance Attention and Self-Evaluated Multi-Pass Deliberation

Operation-guided Neural Networks for High Fidelity Data-To-Text Generation

Incorporating Consistency Verification into Neural Data-to-Document Generation

Select and Attend: Towards Controllable Content Selection in Text Generation

Learning to Select Bi-Aspect Information for Document-Scale Text Content Manipulation

Incorporating Consistency Verification into Neural Data-to-Document Generation.