Abstract:We propose a new length-controllable abstractive summarization model. Recent state-of-the-art abstractive summarization models based on encoder-decoder models generate only one summary per source text. However, controllable summarization, especially of the length, is an important aspect for practical applications. Previous studies on length-controllable abstractive summarization incorporate length embeddings in the decoder module for controlling the summary length. Although the length embeddings can control where to stop decoding, they do not decide which information should be included in the summary within the length constraint. Unlike the previous models, our length-controllable abstractive summarization model incorporates a word-level extractive module in the encoder-decoder model instead of length embeddings. Our model generates a summary in two steps. First, our word-level extractor extracts a sequence of important words (we call it the "prototype text") from the source text according to the word-level importance scores and the length constraint. Second, the prototype text is used as additional input to the encoder-decoder model, which generates a summary by jointly encoding and copying words from both the prototype text and source text. Since the prototype text is a guide to both the content and length of the summary, our model can generate an informative and length-controlled summary. Experiments with the CNN/Daily Mail dataset and the NEWSROOM dataset show that our model outperformed previous models in length-controlled settings.

Zero-Shot Strategies for Length-Controllable Summarization

Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing

Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Bias

Benchmarking Large Language Models for News Summarization

Reinforced Abstractive Summarization with Adaptive Length Controlling

Can Large Language Model Summarizers Adapt to Diverse Scientific Communication Goals?

Length Controlled Generation for Black-box LLMs

Summarization with Precise Length Control

InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Models

Controllable Multi-document Summarization: Coverage & Coherence Intuitive Policy with Large Language Model Based Rewards

An End-to-End Speech Summarization Using Large Language Model

On Learning to Summarize with Large Language Models as References

Summarization is (Almost) Dead

LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models

Zero-shot Faithfulness Evaluation for Text Summarization with Foundation Language Model

Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization

Prompting and Fine-Tuning of Small LLMs for Length-Controllable Telephone Call Summarization

Length-controllable Abstractive Summarization by Guiding with Summary Prototype

A Character-Level Length-Control Algorithm for Non-Autoregressive Sentence Summarization

Zero-Shot Cross-Lingual Summarization via Large Language Models

Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains