Survey of Hallucination in Natural Language Generation

Ziwei Ji,Nayeon Lee,Rita Frieske,Tiezheng Yu,Dan Su,Yan Xu,Etsuko Ishii,Yejin Bang,Delong Chen,Wenliang Dai,Ho Shu Chan,Andrea Madotto,Pascale Fung

DOI: https://doi.org/10.1145/3571730

2024-07-14

Abstract:Natural Language Generation (NLG) has improved exponentially in recent years thanks to the development of sequence-to-sequence deep learning technologies such as Transformer-based language models. This advancement has led to more fluent and coherent NLG, leading to improved development in downstream tasks such as abstractive summarization, dialogue generation and data-to-text generation. However, it is also apparent that deep learning based generation is prone to hallucinate unintended text, which degrades the system performance and fails to meet user expectations in many real-world scenarios. To address this issue, many studies have been presented in measuring and mitigating hallucinated texts, but these have never been reviewed in a comprehensive manner before. In this survey, we thus provide a broad overview of the research progress and challenges in the hallucination problem in NLG. The survey is organized into two parts: (1) a general overview of metrics, mitigation methods, and future directions; (2) an overview of task-specific research progress on hallucinations in the following downstream tasks, namely abstractive summarization, dialogue generation, generative question answering, data-to-text generation, machine translation, and visual-language generation; and (3) hallucinations in large language models (LLMs). This survey serves to facilitate collaborative efforts among researchers in tackling the challenge of hallucinated texts in NLG.

Computation and Language

What problem does this paper attempt to address?

The problem this paper attempts to address is the phenomenon of hallucination in Natural Language Generation (NLG). Specifically, with the development of deep learning-based sequence-to-sequence techniques, such as Transformer models, NLG has made significant progress in generating more fluent and coherent text, which is particularly evident in downstream tasks such as abstractive summarization, dialogue generation, data-to-text generation, and others. However, these models are also prone to generating text that is inconsistent with the input source or meaningless, a phenomenon known as "hallucination," which severely impacts system performance and fails to meet user expectations in many real-world applications.

To tackle this issue, many studies have been dedicated to measuring and mitigating hallucination, but these studies have not yet been comprehensively reviewed. Therefore, this paper aims to provide a comprehensive review covering the following aspects:

1. **Overview of the Hallucination Problem**: Including the definition, classification, causes, evaluation metrics, and mitigation methods of hallucination.
2. **Hallucination in Specific Tasks**: A detailed discussion of hallucination phenomena in tasks such as abstractive summarization, dialogue generation, generative question answering, data-to-text generation, machine translation, and vision-language generation.
3. **Hallucination in Large-Scale Language Models**: Exploring the hallucination phenomena in large-scale language models (LLMs) and their evaluation and mitigation methods.

Through these contents, the paper hopes to promote collaboration among researchers to jointly address the hallucination problem in NLG.