Abstract:Headline generation is an important problem in natural language processing, which aims to describe a document by a compact and informative headline. Some recent successes on this task have been achieved by advanced graph-based neural models, which marry the representational power of deep neural networks with the structural modeling ability of the relational sentence graphs. The advantages of graph-based neural models over traditional Seq2Seq models lie in that they can encode long-distance relationship between sentences beyond the surface linear structure. However, since documents are typically weakly-structured data, modern graph-based neural models usually rely on manually designed rules or some heuristics to construct the sentence graph a prior. This may largely limit the power and increase the cost of the graph-based methods. In this paper, therefore, we propose to incorporate structure learning into the graph-based neural models for headline generation. That is, we want to automatically learn the sentence graph using a data-driven way, so that we can unveil the document structure flexibly without prior heuristics or rules. To achieve this goal, we employ a deep & wide network to encode rich relational information between sentences for the sentence graph learning. For the deep component, we leverage neural matching models, either representation-focused or interaction-focused model, to learn semantic similarity between sentences. For the wide component, we encode a variety of discourse relations between sentences. A Graph Convolutional Network (GCN) is then applied over the sentence graph to generate high-level relational representations for headline generation. The whole model could be optimized end-to-end so that the structure and representation could be learned jointly. Empirical studies show that our model can significantly outperform the state-of-the-art headline generation models.

Better AMR-To-Text Generation with Graph Structure Reconstruction.

AMR-to-Text Generation with Graph Structure Reconstruction and Coverage Mechanism

AMR-To-Text Generation with Graph Transformer.

Line Graph Enhanced Amr-To-Text Generation With Mix-Order Graph Attention Networks

Modeling Graph Structure in Transformer for Better AMR-to-Text Generation.

Latent Tree Decomposition Parsers for AMR-to-Text Generation

From text to graph: a general transition-based AMR parsing using neural network

Guiding transformer to generate graph structure for AMR parsing

A Survey : Neural Networks for AMR-to-Text

Graph Pre-training for AMR Parsing and Generation

Graph Transformer for Graph-to-Sequence Learning

Improving Graph Neural Networks with Structural Adaptive Receptive Fields

Heterogeneous Graph Transformer for Graph-to-Sequence Learning

Triples-to-Text Generation with Reinforcement Learning Based Graph-augmented Neural Networks

Abstractive Document Summarization with a Graph-Based Attentional Neural Model.

Graph-based Multi-hop Reasoning for Long Text Generation.

Unleashing the Power of Language Models in Text-Attributed Graph.

Unleashing the Power of Language Models in Text-Attributed Graph

Graph Structure Reasoning Network for Face Alignment and Reconstruction

Structure Learning for Headline Generation

Controlling Topic-Focus Articulation in Meaning-to-Text Generation using Graph Neural Networks