FactCHD: Benchmarking Fact-Conflicting Hallucination Detection

Xiang Chen,Duanzheng Song,Honghao Gui,Chenxi Wang,Ningyu Zhang,Yong Jiang,Fei Huang,Chengfei Lv,Dan Zhang,Huajun Chen
2024-05-27
Abstract:Despite their impressive generative capabilities, LLMs are hindered by fact-conflicting hallucinations in real-world applications. The accurate identification of hallucinations in texts generated by LLMs, especially in complex inferential scenarios, is a relatively unexplored area. To address this gap, we present FactCHD, a dedicated benchmark designed for the detection of fact-conflicting hallucinations from LLMs. FactCHD features a diverse dataset that spans various factuality patterns, including vanilla, multi-hop, comparison, and set operation. A distinctive element of FactCHD is its integration of fact-based evidence chains, significantly enhancing the depth of evaluating the detectors' explanations. Experiments on different LLMs expose the shortcomings of current approaches in detecting factual errors accurately. Furthermore, we introduce Truth-Triangulator that synthesizes reflective considerations by tool-enhanced ChatGPT and LoRA-tuning based on Llama2, aiming to yield more credible detection through the amalgamation of predictive results and evidence. The benchmark dataset is available at <a class="link-external link-https" href="https://github.com/zjunlp/FactCHD" rel="external noopener nofollow">this https URL</a>.
Computation and Language,Artificial Intelligence,Computer Vision and Pattern Recognition,Information Retrieval,Machine Learning
What problem does this paper attempt to address?
This paper attempts to solve the problem of fact - conflicting hallucinations in text generation by large - language models (LLMs). Specifically, although LLMs have powerful generation capabilities, in practical applications, they are prone to generate content that contradicts facts, which is especially obvious in complex reasoning scenarios. Currently, there are relatively few studies on accurately identifying these hallucinations, especially in complex reasoning situations. Therefore, the paper proposes a special benchmark platform - FACTCHD, which aims to detect fact - conflicting hallucinations in the text generated by LLMs and cover different fact patterns through diverse datasets, including simple fact statements, multi - step reasoning, comparison operations, and set operations. In addition, FACTCHD also introduces fact - based evidence chains to enhance the in - depth evaluation of detector explanations. To verify the performance of different LLMs in detecting fact - conflicting hallucinations, researchers used FACTCHD to benchmark a variety of LLMs, including Alpaca, Llama2 - chat, and ChatGPT, etc. The experimental settings include zero - sample learning, in - context learning, specific - detection tuning, and knowledge enhancement, etc. The experimental results show that specific - detection tuning and knowledge enhancement significantly improve the detection effect of fact - conflicting hallucinations. In addition, the paper also proposes a framework based on the "triangulation" theory - TRUTH - TRIANGULATOR. This framework improves the reliability and accuracy of detection by combining information from different sources to evaluate and adjudicate potential factual differences.