UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen,Yang Liu,Ruochen Xu,Ziyi Yang,Zhu C,Michael Zeng,Yue Zhang

DOI: https://doi.org/10.18653/v1/2023.acl-long.718

2023-01-01

Abstract:Yulong Chen, Yang Liu, Ruochen Xu, Ziyi Yang, Chenguang Zhu, Michael Zeng, Yue Zhang. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023.

What problem does this paper attempt to address?

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

Yulong Chen,Yang Liu,Ruochen Xu,Ziyi Yang,Chenguang Zhu,Michael Zeng,Yue Zhang

DOI: https://doi.org/10.48550/arxiv.2211.09783

2023-01-01

Abstract:The high annotation costs and diverse demands of various summarization tasks motivate the development of few-shot summarization.However, despite the emergence of many summarization tasks and datasets, the current training paradigm for few-shot summarization systems ignores potentially shareable knowledge in heterogeneous datasets.To this end, we propose UniSumm, a unified few-shot summarization model pre-trained with multiple summarization tasks and can be prefix-tuned to excel at any few-shot summarization task.Meanwhile, to better evaluate few-shot summarizers, under the principles of diversity and robustness, we assemble and release a new benchmark SummZoo. It consists of 8 summarization tasks with multiple sets of few-shot samples for each task, covering diverse domains.Experimental results and analysis show that UniSumm outperforms strong baselines by a large margin across all sub-tasks in SummZoo under both automatic and human evaluations and achieves comparable results in human evaluation compared with a GPT-3.5 model.
UniSumm: Unified Few-shot Summarization with Multi-Task Pre-Training and Prefix-Tuning

Yulong Chen,Yang Liu,Ruochen Xu,Ziyi Yang,Chenguang Zhu,Michael Zeng,Yue Zhang

2022-01-01

Abstract: The diverse demands of different summarization tasks and their high annotation costs are driving a need for few-shot summarization. However, despite the emergence of many summarization tasks and datasets, the current training paradigm for few-shot summarization systems ignores potentially shareable knowledge in heterogeneous datasets. To this end, we propose \textsc{UniSumm}, a unified few-shot summarization model pre-trained with multiple summarization tasks and can be prefix-tuned to excel at any few-shot summarization datasets. Meanwhile, to better evaluate few-shot summarization systems, under the principles of diversity and robustness, we assemble and publicize a new benchmark \textsc{SummZoo}. It consists of $8$ diverse summarization tasks with multiple sets of few-shot samples for each task, covering both monologue and dialogue domains. Experimental results and ablation studies show that \textsc{UniSumm} outperforms strong baseline systems by a large margin across all tasks in \textsc{SummZoo} under both automatic and human evaluations. We release our code and benchmark at \url{https://github.com/microsoft/UniSumm}.
UniSumEval: Towards Unified, Fine-Grained, Multi-Dimensional Summarization Evaluation for LLMs

Yuho Lee,Taewon Yun,Jason Cai,Hang Su,Hwanjun Song

2024-10-01

Abstract:Existing benchmarks for summarization quality evaluation often lack diverse input scenarios, focus on narrowly defined dimensions (e.g., faithfulness), and struggle with subjective and coarse-grained annotation schemes. To address these shortcomings, we create UniSumEval benchmark, which extends the range of input context (e.g., domain, length) and provides fine-grained, multi-dimensional annotations. We use AI assistance in data creation, identifying potentially hallucinogenic input texts, and also helping human annotators reduce the difficulty of fine-grained annotation tasks. With UniSumEval, we benchmark nine latest language models as summarizers, offering insights into their performance across varying input contexts and evaluation dimensions. Furthermore, we conduct a thorough comparison of SOTA automated summary evaluators. Our benchmark data will be available at <a class="link-external link-https" href="https://github.com/DISL-Lab/UniSumEval-v1.0" rel="external noopener nofollow">this https URL</a>.

Computation and Language,Artificial Intelligence
An Unsupervised Video Summarization Method Based on Multimodal Representation.

Zhuo Lei,Qiang Yu,Lidan Shou,Shengquan Li,Yunqing Mao

DOI: https://doi.org/10.1007/978-981-99-4761-4_15

2023-01-01

Abstract:A good video summary should convey the whole story and feature the most important content. However, the importance of video content is often subjective, and users should have the option to personalize the summary by using natural language to specify what is important to them. Moreover, existing methods usually apply only visual cues to solve generic video summarization tasks, while this work introduces a single unsupervised multi-modal framework for addressing both generic and query-focused video summarization. We use a multi-head attention model to represent the multi-modal feature. We apply a Transformer-based model to learn the frame scores based on their representative, diversity and reconstruction losses. Especially, we develop a novel representative loss to train the model based on both visual and semantic information. We outperform previous state-of-the-art work with superior results on both generic and query-focused video summarization datasets.
Multisumm: Towards A Unified Model For Multi-Lingual Abstractive Summarization

Yue Cao,Xiaojun Wan,Jin-ge Yao,Dian Yu

DOI: https://doi.org/10.1609/aaai.v34i01.5328

2020-01-01

Abstract:Automatic text summarization aims at producing a shorter version of the input text that conveys the most important information. However, multi-lingual text summarization, where the goal is to process texts in multiple languages and output summaries in the corresponding languages with a single model, has been rarely studied. In this paper, we present MultiSumm, a novel multi-lingual model for abstractive summarization. The MultiSumm model uses the following training regime: (I) multi-lingual learning that contains language model training, auto-encoder training, translation and back-translation training, and (II) joint summary generation training. We conduct experiments on summarization datasets for five rich-resource languages: English, Chinese, French, Spanish, and German, as well as two low-resource languages: Bosnian and Croatian. Experimental results show that our proposed model significantly outperforms a multi-lingual baseline model. Specifically, our model achieves comparable or even better performance than models trained separately on each language. As an additional contribution, we construct the first summarization dataset for Bosnian and Croatian, containing 177,406 and 204,748 samples, respectively.
Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents

Yusen Zhang,Ansong Ni,Ziming Mao,Chen Henry Wu,Chenguang Zhu,Budhaditya Deb,Ahmed H. Awadallah,Dragomir Radev,Rui Zhang

DOI: https://doi.org/10.48550/arXiv.2110.10150

2022-04-14

Abstract:Text summarization helps readers capture salient information from documents, news, interviews, and meetings. However, most state-of-the-art pretrained language models (LM) are unable to efficiently process long text for many summarization tasks. In this paper, we propose Summ$^N$, a simple, flexible, and effective multi-stage framework for input texts that are longer than the maximum context length of typical pretrained LMs. Summ$^N$ first splits the data samples and generates a coarse summary in multiple stages and then produces the final fine-grained summary based on it. Our framework can process input text of arbitrary length by adjusting the number of stages while keeping the LM input size fixed. Moreover, it can deal with both single-source documents and dialogues, and it can be used on top of different backbone abstractive summarization models. To the best of our knowledge, Summ$^N$ is the first multi-stage split-then-summarize framework for long input summarization. Our experiments demonstrate that Summ$^N$ outperforms previous state-of-the-art methods by improving ROUGE scores on three long meeting summarization datasets AMI, ICSI, and QMSum, two long TV series datasets from SummScreen, and a long document summarization dataset GovReport. Our data and code are available at <a class="link-external link-https" href="https://github.com/psunlpgroup/Summ-N" rel="external noopener nofollow">this https URL</a>.

Computation and Language
Unsupervised Multi-Granularity Summarization

Ming Zhong,Yang Liu,Suyu Ge,Yuning Mao,Yizhu Jiao,Xingxing Zhang,Yichong Xu,Chenguang Zhu,Michael Zeng,Jiawei Han

DOI: https://doi.org/10.48550/arXiv.2201.12502

2022-12-14

Abstract:Text summarization is a user-preference based task, i.e., for one document, users often have different priorities for summary. As a key aspect of customization in summarization, granularity is used to measure the semantic coverage between the summary and source document. However, developing systems that can generate summaries with customizable semantic coverage is still an under-explored topic. In this paper, we propose the first unsupervised multi-granularity summarization framework, GranuSum. We take events as the basic semantic units of the source documents and propose to rank these events by their salience. We also develop a model to summarize input documents with given events as anchors and hints. By inputting different numbers of events, GranuSum is capable of producing multi-granular summaries in an unsupervised manner. Meanwhile, we annotate a new benchmark GranuDUC that contains multiple summaries at different granularities for each document cluster. Experimental results confirm the substantial superiority of GranuSum on multi-granularity summarization over strong baselines. Further, by exploiting the event information, GranuSum also exhibits state-of-the-art performance under the conventional unsupervised abstractive setting. Dataset for this paper can be found at: <a class="link-external link-https" href="https://github.com/maszhongming/GranuDUC" rel="external noopener nofollow">this https URL</a>

Computation and Language
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation

Zhengkun Zhang,Xiaojun Meng,Yasheng Wang,Xin Jiang,Qun Liu,Zhenglu Yang

DOI: https://doi.org/10.1609/aaai.v36i10.21431

2022-06-28

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:With the rapid increase of multimedia data, a large body of literature has emerged to work on multimodal summarization, the majority of which target at refining salient information from textual and image modalities to output a pictorial summary with the most relevant images. Existing methods mostly focus on either extractive or abstractive summarization and rely on the presence and quality of image captions to build image references. We are the first to propose a Unified framework for Multimodal Summarization grounding on BART, UniMS, that integrates extractive and abstractive objectives, as well as selecting the image output. Specially, we adopt knowledge distillation from a vision-language pretrained model to improve image selection, which avoids any requirement on the existence and quality of image captions. Besides, we introduce a visual guided decoder to better integrate textual and visual modalities in guiding abstractive text generation. Results show that our best model achieves a new state-of-the-art result on a large-scale benchmark dataset. The newly involved extractive objective as well as the knowledge distillation technique are proven to bring a noticeable improvement to the multimodal summarization task.

English Else
QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

Tao Yu,Ming Zhong,Yang Liu,Asli Celikyilmaz,Rahul Jha,A. Zaidi,Mutethia Mutuma,Da Yin,Xipeng Qiu,Dragomir R. Radev,A. Awadallah

DOI: https://doi.org/10.18653/V1/2021.NAACL-MAIN.472

2021-03-23

Abstract:Meetings are a key component of human collaboration. As increasing numbers of meetings are recorded and transcribed, meeting summaries have become essential to remind those who may or may not have attended the meetings about the key decisions made and the tasks to be completed. However, it is hard to create a single short summary that covers all the content of a long meeting involving multiple people and topics. In order to satisfy the needs of different types of users, we define a new query-based multi-domain meeting summarization task, where models have to select and summarize relevant spans of meetings in response to a query, and we introduce QMSum, a new benchmark for this task. QMSum consists of 1,808 query-summary pairs over 232 meetings in multiple domains. Besides, we investigate a locate-then-summarize method and evaluate a set of strong summarization baselines on the task. Experimental results and manual analysis reveal that QMSum presents significant challenges in long meeting summarization for future research. Dataset is available at https://github.com/Yale-LILY/QMSum.

Computer Science
Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articles

Kung-Hsiang Huang,Philippe Laban,Alexander R. Fabbri,Prafulla Kumar Choubey,Shafiq Joty,Caiming Xiong,Chien-Sheng Wu

2024-03-23

Abstract:Previous research in multi-document news summarization has typically concentrated on collating information that all sources agree upon. However, the summarization of diverse information dispersed across multiple articles about an event remains underexplored. In this paper, we propose a new task of summarizing diverse information encountered in multiple news articles encompassing the same event. To facilitate this task, we outlined a data collection schema for identifying diverse information and curated a dataset named DiverseSumm. The dataset includes 245 news stories, with each story comprising 10 news articles and paired with a human-validated reference. Next, to enable consistent automatic evaluation, we conducted a comprehensive analysis to pinpoint the position and verbosity biases when utilizing Large Language Model (LLM)-based metrics for evaluating the coverage and faithfulness of summaries. Through correlation analyses, we outline the best practices for effectively using automatic LLM-based metrics on the DiverseSumm dataset. Finally, we study how LLMs summarize multiple news articles by analyzing which type of diverse information LLMs are capable of identifying. Our analyses suggest that despite the extraordinary capabilities of LLMs in single-document summarization, the proposed task remains a complex challenge for them mainly due to their limited coverage, with GPT-4 only able to cover under 40% of the diverse information on average.

Computer Science
LMGQS: A Large-scale Dataset for Query-focused Summarization

Ruochen Xu,Song Wang,Yang Liu,Shuohang Wang,Yichong Xu,Dan Iter,Chenguang Zhu,Michael Zeng

2023-05-22

Abstract:Query-focused summarization (QFS) aims to extract or generate a summary of an input document that directly answers or is relevant to a given query. The lack of large-scale datasets in the form of documents, queries, and summaries has hindered model development in this area. In contrast, multiple large-scale high-quality datasets for generic summarization exist. We hypothesize that there is a hidden query for each summary sentence in a generic summarization annotation, and we utilize a large-scale pretrained language model to recover it. In this way, we convert four generic summarization benchmarks into a new QFS benchmark dataset, LMGQS, which consists of over 1 million document-query-summary samples. We thoroughly investigate the properties of our proposed dataset and establish baselines with state-of-the-art summarization models. By fine-tuning a language model on LMGQS, we achieve state-of-the-art zero-shot and supervised performance on multiple existing QFS benchmarks, demonstrating the high quality and diversity of LMGQS.

Computation and Language
Towards a Unified Approach to Simultaneous Single-Document and Multi-Document Summarizations

Xiaojun Wan

2010-01-01

Abstract:Single-document summarization and multi-document summarization are very closely related tasks and they have been widely investigated independently. This paper examines the mutual influences between the two tasks and proposes a novel unified approach to simultaneous single-document and multi-document summarizations. The mutual influences between the two tasks are incorporated into a graph model and the ranking scores of a sentence for the two tasks can be obtained in a unified ranking process. Experimental results on the benchmark DUC datasets demonstrate the effectiveness of the proposed approach for both single-document and multi-document summarizations.
AttSum: Joint Learning of Focusing and Summarization with Neural Attention.

Ziqiang Cao,Wenjie Li,Sujian Li,Furu Wei,Yanran Li

2016-01-01

Abstract:Query relevance ranking and sentence saliency ranking are the two main tasks in extractive query-focused summarization. Previous supervised summarization systems often perform the two tasks in isolation. However, since reference summaries are the trade-off between relevance and saliency, using them as supervision, neither of the two rankers could be trained well. This paper proposes a novel summarization system called AttSum, which tackles the two tasks jointly. It automatically learns distributed representations for sentences as well as the document cluster. Meanwhile, it applies the attention mechanism to simulate the attentive reading of human behavior when a query is given. Extensive experiments are conducted on DUC query-focused summarization benchmark datasets. Without using any hand-crafted features, AttSum achieves competitive performance. It is also observed that the sentences recognized to focus on the query indeed meet the query need.
QTSumm: Query-Focused Summarization over Tabular Data

Yilun Zhao,Zhenting Qi,Linyong Nan,Boyu Mi,Yixin Liu,Weijin Zou,Simeng Han,Ruizhe Chen,Xiangru Tang,Yumo Xu,Dragomir Radev,Arman Cohan

DOI: https://doi.org/10.48550/arXiv.2305.14303

2023-11-07

Abstract:People primarily consult tables to conduct data analysis or answer specific questions. Text generation systems that can provide accurate table summaries tailored to users' information needs can facilitate more efficient access to relevant data insights. Motivated by this, we define a new query-focused table summarization task, where text generation models have to perform human-like reasoning and analysis over the given table to generate a tailored summary. We introduce a new benchmark named QTSumm for this task, which contains 7,111 human-annotated query-summary pairs over 2,934 tables covering diverse topics. We investigate a set of strong baselines on QTSumm, including text generation, table-to-text generation, and large language models. Experimental results and manual analysis reveal that the new task presents significant challenges in table-to-text generation for future research. Moreover, we propose a new approach named ReFactor, to retrieve and reason over query-relevant information from tabular data to generate several natural language facts. Experimental results demonstrate that ReFactor can bring improvements to baselines by concatenating the generated facts to the model input. Our data and code are publicly available at <a class="link-external link-https" href="https://github.com/yale-nlp/QTSumm" rel="external noopener nofollow">this https URL</a>.

Computation and Language
Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method

Yiming Wang,Zhuosheng Zhang,Rui Wang

2023-05-23

Abstract:Automatic summarization generates concise summaries that contain key ideas of source documents. As the most mainstream datasets for the news sub-domain, CNN/DailyMail and BBC XSum have been widely used for performance benchmarking. However, the reference summaries of those datasets turn out to be noisy, mainly in terms of factual hallucination and information redundancy. To address this challenge, we first annotate new expert-writing Element-aware test sets following the "Lasswell Communication Model" proposed by Lasswell (1948), allowing reference summaries to focus on more fine-grained news elements objectively and comprehensively. Utilizing the new test sets, we observe the surprising zero-shot summary ability of LLMs, which addresses the issue of the inconsistent results between human preference and automatic evaluation metrics of LLMs' zero-shot summaries in prior work. Further, we propose a Summary Chain-of-Thought (SumCoT) technique to elicit LLMs to generate summaries step by step, which helps them integrate more fine-grained details of source documents into the final summaries that correlate with the human writing mindset. Experimental results show our method outperforms state-of-the-art fine-tuned PLMs and zero-shot LLMs by +4.33/+4.77 in ROUGE-L on the two datasets, respectively. Dataset and code are publicly available at <a class="link-external link-https" href="https://github.com/Alsace08/SumCoT" rel="external noopener nofollow">this https URL</a>.

Computation and Language
UserSumBench: A Benchmark Framework for Evaluating User Summarization Approaches

Chao Wang,Neo Wu,Lin Ning,Jiaxing Wu,Luyang Liu,Jun Xie,Shawn O'Banion,Bradley Green

2024-09-06

Abstract:Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data. These summaries capture essential user information such as preferences and interests, and therefore are invaluable for LLM-based personalization applications, such as explainable recommender systems. However, the development of new summarization techniques is hindered by the lack of ground-truth labels, the inherent subjectivity of user summaries, and human evaluation which is often costly and time-consuming. To address these challenges, we introduce \UserSumBench, a benchmark framework designed to facilitate iterative development of LLM-based summarization approaches. This framework offers two key components: (1) A reference-free summary quality metric. We show that this metric is effective and aligned with human preferences across three diverse datasets (MovieLens, Yelp and Amazon Review). (2) A novel robust summarization method that leverages time-hierarchical summarizer and self-critique verifier to produce high-quality summaries while eliminating hallucination. This method serves as a strong baseline for further innovation in summarization techniques.

Machine Learning,Artificial Intelligence,Computation and Language
GUMSum: Multi-Genre Data and Evaluation for English Abstractive Summarization

Yang Janet Liu,Amir Zeldes

2023-06-20

Abstract:Automatic summarization with pre-trained language models has led to impressively fluent results, but is prone to 'hallucinations', low performance on non-news genres, and outputs which are not exactly summaries. Targeting ACL 2023's 'Reality Check' theme, we present GUMSum, a small but carefully crafted dataset of English summaries in 12 written and spoken genres for evaluation of abstractive summarization. Summaries are highly constrained, focusing on substitutive potential, factuality, and faithfulness. We present guidelines and evaluate human agreement as well as subjective judgments on recent system outputs, comparing general-domain untuned approaches, a fine-tuned one, and a prompt-based approach, to human performance. Results show that while GPT3 achieves impressive scores, it still underperforms humans, with varying quality across genres. Human judgments reveal different types of errors in supervised, prompted, and human-generated summaries, shedding light on the challenges of producing a good summary.

Computation and Language
An End-to-End Speech Summarization Using Large Language Model

Hengchao Shang,Zongyao Li,Jiaxin Guo,Shaojun Li,Zhiqiang Rao,Yuanchang Luo,Daimeng Wei,Hao Yang

2024-07-02

Abstract:Abstractive Speech Summarization (SSum) aims to generate human-like text summaries from spoken content. It encounters difficulties in handling long speech input and capturing the intricate cross-modal mapping between long speech inputs and short text summaries. Research on large language models (LLMs) and multimodal information fusion has provided new insights for addressing these challenges. In this paper, we propose an end-to-end SSum model that utilizes Q-Former as a connector for the audio-text modality and employs LLMs to generate text summaries directly from speech features. We adopt a multi-stage training approach that includes LLM based ASR and Text Summarization (TSum) tasks as auxiliary tasks. ASR tasks are used to align feature spaces and enhance the LLM's ability to handle longer speech. Then, we utilize a curriculum learning strategy to facilitate the model's transition from TSum to SSum. Finally, our model achieves competitive performance on the How-2 dataset.

Computation and Language,Sound,Audio and Speech Processing
Large-Scale Multi-Document Summarization with Information Extraction and Compression

Ning Wang,Han Liu,Diego Klabjan

DOI: https://doi.org/10.48550/arXiv.2205.00548

2022-05-02

Abstract:We develop an abstractive summarization framework independent of labeled data for multiple heterogeneous documents. Unlike existing multi-document summarization methods, our framework processes documents telling different stories instead of documents on the same topic. We also enhance an existing sentence fusion method with a uni-directional language model to prioritize fused sentences with higher sentence probability with the goal of increasing readability. Lastly, we construct a total of twelve dataset variations based on CNN/Daily Mail and the NewsRoom datasets, where each document group contains a large and diverse collection of documents to evaluate the performance of our model in comparison with other baseline systems. Our experiments demonstrate that our framework outperforms current state-of-the-art methods in this more generic setting.

Computation and Language,Information Retrieval
Information-Theoretic Distillation for Reference-less Summarization

Jaehun Jung,Ximing Lu,Liwei Jiang,Faeze Brahman,Peter West,Pang Wei Koh,Yejin Choi

2024-08-20

Abstract:The current winning recipe for automatic summarization is using proprietary large-scale language models (LLMs) such as ChatGPT as is, or imitation learning from them as teacher models. While increasingly ubiquitous dependence on such large-scale language models is convenient, there remains an important question of whether small-scale models could have achieved competitive results, if we were to seek an alternative learning method -- that allows for a more cost-efficient, controllable, yet powerful summarizer. We present InfoSumm, a novel framework to distill a powerful summarizer based on the information-theoretic objective for summarization, without relying on either the LLM's capability or human-written references. To achieve this, we first propose a novel formulation of the desiderata of summarization (saliency, faithfulness and brevity) through the lens of mutual information between the original document and the summary. Based on this formulation, we start off from Pythia-2.8B as the teacher model, which is not yet capable of summarization, then self-train the model to optimize for the information-centric measures of ideal summaries. Distilling from the improved teacher, we arrive at a compact but powerful summarizer with only 568M parameters that performs competitively against ChatGPT, without ever relying on ChatGPT's capabilities. Extensive analysis demonstrates that our approach outperforms in-domain supervised models in human evaluation, let alone state-of-the-art unsupervised methods, and wins over ChatGPT in controllable summarization.

Computation and Language,Artificial Intelligence

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

UniSumm and SummZoo: Unified Model and Diverse Benchmark for Few-Shot Summarization

UniSumm: Unified Few-shot Summarization with Multi-Task Pre-Training and Prefix-Tuning

UniSumEval: Towards Unified, Fine-Grained, Multi-Dimensional Summarization Evaluation for LLMs

An Unsupervised Video Summarization Method Based on Multimodal Representation.

Multisumm: Towards A Unified Model For Multi-Lingual Abstractive Summarization

Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents

Unsupervised Multi-Granularity Summarization

UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation

QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization

Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articles

LMGQS: A Large-scale Dataset for Query-focused Summarization

Towards a Unified Approach to Simultaneous Single-Document and Multi-Document Summarizations

AttSum: Joint Learning of Focusing and Summarization with Neural Attention.

QTSumm: Query-Focused Summarization over Tabular Data

Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method

UserSumBench: A Benchmark Framework for Evaluating User Summarization Approaches

GUMSum: Multi-Genre Data and Evaluation for English Abstractive Summarization

An End-to-End Speech Summarization Using Large Language Model

Large-Scale Multi-Document Summarization with Information Extraction and Compression

Information-Theoretic Distillation for Reference-less Summarization