Abstract:Since large language models (LLMs) achieve significant success in recent years, the hallucination issue remains a challenge, numerous benchmarks are proposed to detect the hallucination. Nevertheless, some of these benchmarks are not naturally generated by LLMs but are intentionally induced. Also, many merely focus on the factuality hallucination while ignoring the faithfulness hallucination. Additionally, although dialogue pattern is more widely utilized in the era of LLMs, current benchmarks only concentrate on sentence-level and passage-level hallucination. In this study, we propose DiaHalu, the first dialogue-level hallucination evaluation benchmark to our knowledge. Initially, we integrate the collected topics into system prompts and facilitate a dialogue between two ChatGPT3.5. Subsequently, we manually modify the contents that do not adhere to human language conventions and then have LLMs re-generate, simulating authentic human-machine interaction scenarios. Finally, professional scholars annotate all the samples in the dataset. DiaHalu covers four common multi-turn dialogue domains and five hallucination subtypes, extended from factuality and faithfulness hallucination. Experiments through some well-known LLMs and detection methods on the dataset show that DiaHalu is a challenging benchmark, holding significant value for further research.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the hallucination problem in large - language models (LLMs). Although LLMs have achieved remarkable success in recent years, the hallucination problem remains a major challenge. Specifically, some existing hallucination - detection benchmarks have the following problems: 1. **Unnatural Generation**: Many existing hallucination - detection benchmarks induce the generation of hallucinatory content through manually - designed trigger prompts, rather than being naturally generated by LLMs during daily use. 2. **Only Focus on Factual Hallucinations**: Most benchmarks only focus on detecting factual hallucinations and ignore faithfulness hallucinations. Factual hallucinations refer to the generated content that does not conform to real - world facts, while faithfulness hallucinations refer to the generated content that is inconsistent with user instructions or other inputs, or the generated content is internally inconsistent. 3. **Only Concentrate on Sentence - level and Paragraph - level**: Existing hallucination - detection benchmarks mainly concentrate on sentence - level and paragraph - level, while the dialogue mode is more widely used in LLMs, and the unique types of hallucinations in dialogue are more difficult to detect. To solve these problems, the paper proposes a benchmark specifically for dialogue - level hallucination detection - DiaHalu. DiaHalu covers four common multi - turn dialogue domains (knowledge - based dialogue, task - oriented dialogue, small - talk dialogue, and reasoning - based dialogue) and extends five hallucination subtypes (derived from factual hallucinations and faithfulness hallucinations). The experimental results show that DiaHalu is a challenging benchmark and is of great significance for further research.

DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Models

HalluDial: A Large-Scale Benchmark for Automatic Dialogue-Level Hallucination Evaluation

HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models

VisDiaHalBench: A Visual Dialogue Benchmark For Diagnosing Hallucination in Large Vision-Language Models

LongHalQA: Long-Context Hallucination Evaluation for MultiModal Large Language Models

Evaluating the Quality of Hallucination Benchmarks for Large Vision-Language Models

The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models

HaluEval-Wild: Evaluating Hallucinations of Language Models in the Wild

Hallucination Detection and Hallucination Mitigation: An Investigation

UHGEval: Benchmarking the Hallucination of Chinese Large Language Models via Unconstrained Generation

MedHallBench: A New Benchmark for Assessing Hallucination in Medical Large Language Models

MedHalu: Hallucinations in Responses to Healthcare Queries by Large Language Models

Evaluation and Analysis of Hallucination in Large Vision-Language Models

ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Models

Evaluating Hallucinations in Chinese Large Language Models

ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Models

The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models

Detecting and Evaluating Medical Hallucinations in Large Vision Language Models

Med-HALT: Medical Domain Hallucination Test for Large Language Models