Abstract:Large language models (LLMs) have demonstrated impressive proficiency in information retrieval, while they are prone to generating incorrect responses that conflict with reality, a phenomenon known as intrinsic hallucination. The critical challenge lies in the unclear and unreliable fact distribution within LLMs trained on vast amounts of data. The prevalent approach frames the factual detection task as a question-answering paradigm, where the LLMs are asked about factual knowledge and examined for correctness. However, existing studies primarily focused on deriving test cases only from several specific domains, such as movies and sports, limiting the comprehensive observation of missing knowledge and the analysis of unexpected hallucinations. To address this issue, we propose OntoFact, an adaptive framework for detecting unknown facts of LLMs, devoted to mining the ontology-level skeleton of the missing knowledge. Specifically, we argue that LLMs could expose the ontology-based similarity among missing facts and introduce five representative knowledge graphs (KGs) as benchmarks. We further devise a sophisticated ontology-driven reinforcement learning (ORL) mechanism to produce error-prone test cases with specific entities and relations automatically. The ORL mechanism rewards the KGs for navigating toward a feasible direction for unveiling factual errors. Moreover, empirical efforts demonstrate that dominant LLMs are biased towards answering Yes rather than No, regardless of whether this knowledge is included. To mitigate the overconfidence of LLMs, we leverage a hallucination-free detection (HFD) strategy to tackle unfair comparisons between baselines, thereby boosting the result robustness. Experimental results on 5 datasets, using 32 representative LLMs, reveal a general lack of fact in current LLMs. Notably, ChatGPT exhibits fact error rates of 51.6% on DBpedia and 64.7% on YAGO, respectively. Additionally, the ORL mechanism demonstrates promising error prediction scores, with F1 scores ranging from 70% to 90% across most LLMs. Compared to the exhaustive testing, ORL achieves an average recall of 80% while reducing evaluation time by 35.29% to 63.12%.

HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claims

Evidence-based Interpretable Open-domain Fact-checking with Large Language Models

AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG task

Herd: Using multiple, smaller LLMs to match the performances of proprietary, large LLMs via an intelligent composer

Automated Claim Matching with Large Language Models: Empowering Fact-Checkers in the Fight Against Misinformation

Multi-hop Evidence Pursuit Meets the Web: Team Papelo at FEVER 2024

Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models

VERITAS: A Unified Approach to Reliability Evaluation

Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments

FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checking

Re-Search for The Truth: Multi-round Retrieval-augmented Large Language Models are Strong Fake News Detectors

"The Data Says Otherwise"-Towards Automated Fact-checking and Communication of Data Claims

OntoFact: Unveiling Fantastic Fact-Skeleton of LLMs Via Ontology-Driven Reinforcement Learning

Are Large Language Models Good Fact Checkers: A Preliminary Study

Claim Verification in the Age of Large Language Models: A Survey

VerifiNER: Verification-augmented NER via Knowledge-grounded Reasoning with Large Language Models

UFO: a Unified and Flexible Framework for Evaluating Factuality of Large Language Models

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models

An Investigation of Large Language Models for Real-World Hate Speech Detection

Evidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMs

Trust but Verify: Programmatic VLM Evaluation in the Wild