Abstract:Unsupervised extractive summarization aims to extract salient sentences from the document without labeled corpus. Existing methods have achieved promising progress, thanks to the power of large-scale pre-trained language models and high-quality contextualized representations. However, extractive summaries often fail to maintain smooth transitions between sentences and struggle to form a coherent and fluent text due to splicing of sentences. Nevertheless, to the best of our knowledge, very few studies currently focus on unsupervised abstractive summarization. Inspired by the intuitive human process of writing summaries, which involves extracting salient sentences first and then reconstructing them, in this paper, we propose an Extract-then-Abstract framework to generate more coherent and human-like summary. Specifically, we first adopt extractive summarization model as summarizer to generate extractive summary in the extraction stage. Then in the abstraction stage, we propose a BART-based sentence write model to generate more coherent and fluent abstractive summary. To this end, we design a novel parallel data creation method for our rewrite model by proposing an effective sentence sampling strategy without any manual annotation cost. Extensive experiments including automatic evaluation and human evaluation demonstrate that our framework consistently outperforms strong baselines for unsupervised abstractive summarization and can generate more coherent and human-like summary while maintaining in competitive ROUGE scores for unsupervised extractive summarization.

Automatically Extracting Summaries with a Novel Unsupervised Framework

Generating Aspect-oriented Multi-Document Summarization with Event-aspect Model.

SJTU CIT at TAC 2010: Guided Summarization Task.

A spectral analysis approach to document summarization: Clustering and ranking sentences simultaneously.

Automatically Building Templates for Entity Summary Construction

A Supervised Aggregation Framework for Multi-Document Summarization.

Multidocument Aspect Classification for Aspect-Based Abstractive Summarization

Automatic Document Summarization Via Deep Neural Networks

Generating templates of entity summaries with an entity-aspect model and pattern mining

Multi-document Summarization via LDA and Density Peaks Based Sentence-Level Clustering

Improving Unsupervised Extractive Summarization with Facet-Aware Modeling

Sentences clustering based automatic summarization

An Improved LDA Multi-document Summarization Model Based on TensorFlow

Unsupervised Abstractive Summarization Via Sentence Rewriting

Extractive Summarization Using Supervised and Unsupervised Learning.

Topic Aspect-Oriented Summarization Via Group Selection

Query-oriented unsupervised multi-document summarization via deep learning model

Generating Coherent Summaries with Textual Aspects

Towards A Unified Approach Based On Affinity Graph To Various Multi-Document Summarizations

AsU-OSum: Aspect-augmented unsupervised opinion summarization

A Study of Unsupervised Multi-document Sentiment Summarization Techniques Based on Graph Structure