Abstract:Although many studies have investigated and reduced hallucinations in large language models (LLMs) for single-document tasks, research on hallucination in multi-document summarization (MDS) tasks remains largely unexplored. Specifically, it is unclear how the challenges arising from handling multiple documents (e.g., repetition and diversity of information) affect models outputs. In this work, we investigate how hallucinations manifest in LLMs when summarizing topic-specific information from multiple documents. Since no benchmarks exist for investigating hallucinations in MDS, we use existing news and conversation datasets, annotated with topic-specific insights, to create two novel multi-document benchmarks. When evaluating 5 LLMs on our benchmarks, we observe that on average, up to 75% of the content in LLM-generated summary is hallucinated, with hallucinations more likely to occur towards the end of the summaries. Moreover, when summarizing non-existent topic-related information, gpt-3.5-turbo and GPT-4o still generate summaries about 79.35% and 44% of the time, raising concerns about their tendency to fabricate content. To understand the characteristics of these hallucinations, we manually evaluate 700+ insights and find that most errors stem from either failing to follow instructions or producing overly generic insights. Motivated by these observations, we investigate the efficacy of simple post-hoc baselines in mitigating hallucinations but find them only moderately effective. Our results underscore the need for more effective approaches to systematically mitigate hallucinations in MDS. We release our dataset and code at <a class="link-external link-http" href="http://github.com/megagonlabs/Hallucination_MDS" rel="external noopener nofollow">this http URL</a>.

Alleviating Hallucinations Via Supportive Window Indexing in Abstractive Summarization

Mitigating Hallucination in Abstractive Summarization with Domain-Conditional Mutual Information

Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and Selection

Reducing Quantity Hallucinations in Abstractive Summarization

Detecting and Mitigating Hallucinations in Multilingual Summarisation

Correction with Backtracking Reduces Hallucination in Summarization

From Single to Multi: How LLMs Hallucinate in Multi-Document Summarization

Hallucination Diversity-Aware Active Learning for Text Summarization

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization

Don't Believe Everything You Read: Enhancing Summarization Interpretability through Automatic Identification of Hallucinations in Large Language Models

Abstract Summarization Model Based on Semantic Graphs and Entity Pointers

Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trends

Improved Beam Search for Hallucination Mitigation in Abstractive Summarization

Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization

Reducing Hallucinations in Entity Abstract Summarization with Facts-Template Decomposition

Improving Factual Consistency of Text Summarization by Adversarially Decoupling Comprehension and Embellishment Abilities of LLMs

Leveraging Entailment Judgements in Cross-Lingual Summarisation

Retrieve Only When It Needs: Adaptive Retrieval Augmentation for Hallucination Mitigation in Large Language Models

FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMs

Factored Verification: Detecting and Reducing Hallucination in Summaries of Academic Papers