Abstract:Current abstractive summarization models either suffer from a lack of clear interpretability or provide incomplete rationales by only highlighting parts of the source document. To this end, we propose the Summarization Program (SP), an interpretable modular framework consisting of an (ordered) list of binary trees, each encoding the step-by-step generative process of an abstractive summary sentence from the source document. A Summarization Program contains one root node per summary sentence, and a distinct tree connects each summary sentence (root node) to the document sentences (leaf nodes) from which it is derived, with the connecting nodes containing intermediate generated sentences. Edges represent different modular operations involved in summarization such as sentence fusion, compression, and paraphrasing. We first propose an efficient best-first search method over neural modules, SP-Search that identifies SPs for human summaries by directly optimizing for ROUGE scores. Next, using these programs as automatic supervision, we propose seq2seq models that generate Summarization Programs, which are then executed to obtain final summaries. We demonstrate that SP-Search effectively represents the generative process behind human summaries using modules that are typically faithful to their intended behavior. We also conduct a simulation study to show that Summarization Programs improve the interpretability of summarization models by allowing humans to better simulate model reasoning. Summarization Programs constitute a promising step toward interpretable and modular abstractive summarization, a complex task previously addressed primarily through blackbox end-to-end neural systems. Supporting code available at https://github.com/swarnaHub/SummarizationPrograms

SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarization

VSumVis: Interactive Visual Understanding and Diagnosis of Video Summarization Model

Survey on Abstractive Text Summarization: Dataset, Models, and Metrics

SummEval: Re-evaluating Summarization Evaluation

Exploring Neural Models for Query-Focused Summarization

SEASum: Syntax-Enriched Abstractive Summarization

StarSum: A Star Architecture Based Model for Extractive Summarization

Topic-based Visual Text Summarization and Analysis 1

VideoXum: Cross-modal Visual and Textural Summarization of Videos

UniSumEval: Towards Unified, Fine-Grained, Multi-Dimensional Summarization Evaluation for LLMs

Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees

OpinSummEval: Revisiting Automated Evaluation for Opinion Summarization

Assessment of Transformer-Based Encoder-Decoder Model for Human-Like Summarization

SummScore: A Comprehensive Evaluation Metric for Summary Quality Based on Cross-Encoder

Neural Abstractive Text Summarization with Sequence-to-Sequence Models

See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarization

CDEvalSumm: an Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems

Summaformers @ LaySumm 20, LongSumm 20

A Survey of the State-of-the-Art Models in Neural Abstractive Text Summarization

Abstractive Summarization Using Attentive Neural Techniques

GUMSum: Multi-Genre Data and Evaluation for English Abstractive Summarization