Abstract:This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and remarkable abilities in multimodal tasks. Despite these promising developments, MLLMs often generate outputs that are inconsistent with the visual content, a challenge known as hallucination, which poses substantial obstacles to their practical deployment and raises concerns regarding their reliability in real-world applications. This problem has attracted increasing attention, prompting efforts to detect and mitigate such inaccuracies. We review recent advances in identifying, evaluating, and mitigating these hallucinations, offering a detailed overview of the underlying causes, evaluation benchmarks, metrics, and strategies developed to address this issue. Additionally, we analyze the current challenges and limitations, formulating open questions that delineate potential pathways for future research. By drawing the granular classification and landscapes of hallucination causes, evaluation benchmarks, and mitigation methods, this survey aims to deepen the understanding of hallucinations in MLLMs and inspire further advancements in the field. Through our thorough and in-depth review, we contribute to the ongoing dialogue on enhancing the robustness and reliability of MLLMs, providing valuable insights and resources for researchers and practitioners alike. Resources are available at:

Generalization vs. Hallucination

Embedding and Gradient Say Wrong: A White-Box Method for Hallucination Detection

Banishing LLM Hallucinations Requires Rethinking Generalization

Hallucination is Inevitable: An Innate Limitation of Large Language Models

Federated Adversarial Domain Hallucination for Privacy-preserving Domain Generalization

On Large Language Models' Hallucination with Regard to Known Facts

Knowledge Overshadowing Causes Amalgamated Hallucination in Large Language Models

Hallucination Detection and Hallucination Mitigation: An Investigation

No Free Lunch: Fundamental Limits of Learning Non-Hallucinating Generative Models

Evaluation and Analysis of Hallucination in Large Vision-Language Models

Hallucination of Multimodal Large Language Models: A Survey

A Unified Hallucination Mitigation Framework for Large Vision-Language Models

Mechanistic Understanding and Mitigation of Language Model Non-Factual Hallucinations

A Survey on Hallucination in Large Vision-Language Models

Unravelling the Mysteries of Hallucination in Large Language Models: Strategies for Precision in Artificial Intelligence Language Generation

Quantifying and Attributing the Hallucination of Large Language Models via Association Analysis