Abstract:Unsupervised extractive summarization is an important technique in information extraction and retrieval. Compared with supervised method, it does not require high-quality human-labelled summaries for training and thus can be easily applied for documents with different types, domains or languages. Most of existing unsupervised methods including TextRank and PACSUM rely on graph-based ranking on sentence centrality. However, this scorer can not be directly applied in end-to-end training, and the positional-related prior assumption is often needed for achieving good summaries. In addition, less attention is paid to length-controllable extractor, where users can decide to summarize texts under particular length constraint. This paper introduces an unsupervised extractive summarization model based on a siamese network, for which we develop a trainable bidirectional prediction objective between the selected summary and the original document. Different from the centrality-based ranking methods, our extractive scorer can be trained in an end-to-end manner, with no other requirement of positional assumption. In addition, we introduce a differentiable length control module by approximating 0-1 knapsack solver for end-to-end length-controllable extracting. Experiments show that our unsupervised method largely outperforms the centrality-based baseline using a same sentence encoder. In terms of length control ability, via our trainable knapsack module, the performance consistently outperforms the strong baseline without utilizing end-to-end training. Human evaluation further evidences that our method performs the best among baselines in terms of relevance and consistency.

Exploiting Surface, Content and Relevance Features for Learning-Based Extractive Summarization

Exploring hypergraph-based semi-supervised ranking for query-oriented summarization

Extractive Summarization Using Inter- and Intra- Event Relevance.

At Which Level Should We Extract? An Empirical Analysis on Extractive Document Summarization

DCDSum: An interpretable extractive summarization framework based on contrastive learning method

A Topic-sensitive Extractive Method for Multi-document Summarization

Simultaneous Ranking and Clustering of Sentences: A Reinforcement Approach to Multi-Document Summarization.

Exploring Explainable Selection to Control Abstractive Summarization

EDU-level Extractive Summarization with Varying Summary Lengths

Enhancing Diversity, Coverage and Balance for Summarization Through Structure Learning

Document Summarization Via Self-Present Sentence Relevance Model.

Exploiting Relevance, Coverage, and Novelty for Query-Focused Multi-Document Summarization

Extractive Summarization As Text Matching

Subtopic-Focused Sentence Scoring in Multi-document Summarization.

A study of extractive summarization of long documents incorporating local topic and hierarchical information

Developing Learning Strategies for Topic-Based Summarization

Improving Unsupervised Extractive Summarization with Facet-Aware Modeling

Exploiting the Role of Named Entities in Query-Oriented Document Summarization.

Abstractive Summarization Improved by WordNet-based Extractive Sentences

Unsupervised Extractive Summarization with Learnable Length Control Strategies

Learning Summary Prior Representation for Extractive Summarization.