Abstract:Automatic summarization generates concise summaries that contain key ideas of source documents. As the most mainstream datasets for the news sub-domain, CNN/DailyMail and BBC XSum have been widely used for performance benchmarking. However, the reference summaries of those datasets turn out to be noisy, mainly in terms of factual hallucination and information redundancy. To address this challenge, we first annotate new expert-writing Element-aware test sets following the "Lasswell Communication Model" proposed by Lasswell (1948), allowing reference summaries to focus on more fine-grained news elements objectively and comprehensively. Utilizing the new test sets, we observe the surprising zero-shot summary ability of LLMs, which addresses the issue of the inconsistent results between human preference and automatic evaluation metrics of LLMs' zero-shot summaries in prior work. Further, we propose a Summary Chain-of-Thought (SumCoT) technique to elicit LLMs to generate summaries step by step, which helps them integrate more fine-grained details of source documents into the final summaries that correlate with the human writing mindset. Experimental results show our method outperforms state-of-the-art fine-tuned PLMs and zero-shot LLMs by +4.33/+4.77 in ROUGE-L on the two datasets, respectively. Dataset and code are publicly available at <a class="link-external link-https" href="https://github.com/Alsace08/SumCoT" rel="external noopener nofollow">this https URL</a>.

Multi-lingualWikipedia Summarization and Title Generation on Low Resource Corpus

Learning to Generate Wikipedia Summaries for Underserved Languages from Wikidata

XWikiGen: Cross-lingual Summarization for Encyclopedic Text Generation in Low Resource Languages

Meta-Transfer Learning for Low-Resource Abstractive Summarization

WikiMulti: a Corpus for Cross-Lingual Summarization

Multisumm: Towards A Unified Model For Multi-Lingual Abstractive Summarization

Edisum: Summarizing and Explaining Wikipedia Edits at Scale

Zero-Shot Cross-Lingual Abstractive Sentence Summarization Through Teaching Generation and Attention

WikiSummarizer - A Wikipedia-based Summarization System.

Research on Multi-document Summarization Using Lexical Cohesion

Large-Scale Multi-Document Summarization with Information Extraction and Compression

Multi-path Based Self-adaptive Cross-lingual Summarization.

A Mixed-Language Multi-Document News Summarization Dataset and a Graphs-Based Extract-Generate Model

Contrastive Aligned Joint Learning for Multilingual Summarization.

Using Bilingual Information for Cross-Language Document Summarization

Towards Unifying Multi-Lingual and Cross-Lingual Summarization

MTL-DAS: Automatic Text Summarization for Domain Adaptation

Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method

Multi-Target Cross-Lingual Summarization: a novel task and a language-neutral approach

Controllable Multi-document Summarization: Coverage & Coherence Intuitive Policy with Large Language Model Based Rewards

Cross-Lingual Abstractive Summarization with Limited Parallel Resources.