Abstract:Unsupervised extractive summarization is an important technique in information extraction and retrieval. Compared with supervised method, it does not require high-quality human-labelled summaries for training and thus can be easily applied for documents with different types, domains or languages. Most of existing unsupervised methods including TextRank and PACSUM rely on graph-based ranking on sentence centrality. However, this scorer can not be directly applied in end-to-end training, and the positional-related prior assumption is often needed for achieving good summaries. In addition, less attention is paid to length-controllable extractor, where users can decide to summarize texts under particular length constraint. This paper introduces an unsupervised extractive summarization model based on a siamese network, for which we develop a trainable bidirectional prediction objective between the selected summary and the original document. Different from the centrality-based ranking methods, our extractive scorer can be trained in an end-to-end manner, with no other requirement of positional assumption. In addition, we introduce a differentiable length control module by approximating 0-1 knapsack solver for end-to-end length-controllable extracting. Experiments show that our unsupervised method largely outperforms the centrality-based baseline using a same sentence encoder. In terms of length control ability, via our trainable knapsack module, the performance consistently outperforms the strong baseline without utilizing end-to-end training. Human evaluation further evidences that our method performs the best among baselines in terms of relevance and consistency.

Summarization with Precise Length Control

A Character-Level Length-Control Algorithm for Non-Autoregressive Sentence Summarization

Length-controllable Abstractive Summarization by Guiding with Summary Prototype

Controllable Summarization with Constrained Markov Decision Process

Reinforced Abstractive Summarization with Adaptive Length Controlling

Unsupervised Extractive Summarization with Learnable Length Control Strategies

CTRLsum: Towards Generic Controllable Text Summarization

A Focused Study on Sequence Length for Dialogue Summarization

Generating Summaries with Controllable Readability Levels

Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents

A New Approach to Overgenerating and Scoring Abstractive Summaries

Training Dynamics for Text Summarization Models

A Decoding Algorithm for Length-Control Summarization Based on Directed Acyclic Transformers

Dual-Level Contrastive Learning for Improving Conciseness of Summarization

Prompt-Based Length Controlled Generation with Multiple Control Types

Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization

A Novel LLM-based Two-stage Summarization Approach for Long Dialogues

CNNSum: Exploring Long-Context Summarization with Large Language Models in Chinese Novels

Prompting and Fine-Tuning of Small LLMs for Length-Controllable Telephone Call Summarization

Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization