Abstract:Unsupervised extractive summarization aims to extract salient sentences from the document without labeled corpus. Existing methods have achieved promising progress, thanks to the power of large-scale pre-trained language models and high-quality contextualized representations. However, extractive summaries often fail to maintain smooth transitions between sentences and struggle to form a coherent and fluent text due to splicing of sentences. Nevertheless, to the best of our knowledge, very few studies currently focus on unsupervised abstractive summarization. Inspired by the intuitive human process of writing summaries, which involves extracting salient sentences first and then reconstructing them, in this paper, we propose an Extract-then-Abstract framework to generate more coherent and human-like summary. Specifically, we first adopt extractive summarization model as summarizer to generate extractive summary in the extraction stage. Then in the abstraction stage, we propose a BART-based sentence write model to generate more coherent and fluent abstractive summary. To this end, we design a novel parallel data creation method for our rewrite model by proposing an effective sentence sampling strategy without any manual annotation cost. Extensive experiments including automatic evaluation and human evaluation demonstrate that our framework consistently outperforms strong baselines for unsupervised abstractive summarization and can generate more coherent and human-like summary while maintaining in competitive ROUGE scores for unsupervised extractive summarization.

AMR-to-Text Generation with Graph Structure Reconstruction and Coverage Mechanism

Better AMR-To-Text Generation with Graph Structure Reconstruction.

AMR-To-Text Generation with Graph Transformer.

Enhancing AMR-to-Text Generation with Dual Graph Representations

Modeling Graph Structure in Transformer for Better AMR-to-Text Generation.

Line Graph Enhanced Amr-To-Text Generation With Mix-Order Graph Attention Networks

A Survey : Neural Networks for AMR-to-Text

Guiding transformer to generate graph structure for AMR parsing

Graph Pre-training for AMR Parsing and Generation

From text to graph: a general transition-based AMR parsing using neural network

Enriched Entity Representation of Knowledge Graph for Text Generation

Neural amr: Sequence-to-sequence models for parsing and generation

GPT-too: A language-model-first approach for AMR-to-text generation

Graph Transformer for Graph-to-Sequence Learning

Heterogeneous Graph Transformer for Graph-to-Sequence Learning

Guiding AMR Parsing with Reverse Graph Linearization

Abstractive summarization incorporating graph knowledge

Latent Tree Decomposition Parsers for AMR-to-Text Generation

Improving Neural Machine Translation with AMR Semantic Graphs

Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing

Unsupervised Abstractive Summarization Via Sentence Rewriting