Abstract:In this paper, we propose ZeFaV - a zero-shot based fact-checking verification framework to enhance the performance on fact verification task of large language models by leveraging the in-context learning ability of large language models to extract the relations among the entities within a claim, re-organized the information from the evidence in a relationally logical form, and combine the above information with the original evidence to generate the context from which our fact-checking model provide verdicts for the input claims. We conducted empirical experiments to evaluate our approach on two multi-hop fact-checking datasets including HoVer and FEVEROUS, and achieved potential results results comparable to other state-of-the-art fact verification task methods.

What problem does this paper attempt to address?

This paper aims to address several key challenges in the automated fact - verification task. Specifically, these challenges include: 1. **Ambiguity of statements**: When a statement can have multiple interpretations, it complicates automated fact - verification. 2. **Data bias**: Data deviation in the labeled dataset may lead to deviation in the system's prediction results. 3. **Limitations of context information**: The current state - of - the - art systems have limitations when dealing with external knowledge sources and user - generated information. 4. **Cost and time consumption of labeled data**: Creating labeled data for fact - verification is both expensive and time - consuming, and may be biased. To address these challenges, the authors propose a framework named ZeFaV, which utilizes zero - sample learning techniques to enhance the performance of large - language models (LLMs) in fact - verification tasks. ZeFaV improves the capabilities of LLMs in the following aspects: - **Relation extraction**: Through few - shot learning, identify entities in statements and evidence and their relationships, helping LLMs better understand and verify statements. - **InfoRE (Information Reorganization)**: Reorganize the provided evidence into a more understandable text format, enhancing the model's context - learning ability. - **Combining relations and reorganized information**: Combine the extracted relations and reorganized information with the original evidence to form a comprehensive context for LLMs to perform fact - verification. Through these methods, ZeFaV can improve the performance of LLMs in fact - verification tasks without additional training. The paper also reports experimental results on two multi - hop fact - verification datasets, HoVer and FEVEROUS, indicating that ZeFaV achieves performance comparable to or even better than the existing state - of - the - art methods on these tasks.

ZeFaV: Boosting Large Language Models for Zero-shot Fact Verification

Zero-Shot Fact Verification via Natural Logic and Large Language Models

Are Large Language Models Table-based Fact-Checkers?

Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphs

Robust Claim Verification Through Fact Detection

Evidence-based Interpretable Open-domain Fact-checking with Large Language Models

ZVQAF: Zero-shot visual question answering with feedback from large language models

Unsupervised Pretraining for Fact Verification by Language Model Distillation

Zero-Shot Learning and Key Points Are All You Need for Automated Fact-Checking

Evaluating Large Language Model Capability in Vietnamese Fact-Checking Data Generation

Are Large Language Models Good Fact Checkers: A Preliminary Study

A Multi-Level Attention Model for Evidence-Based Fact Checking

Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model

Claim-Dissector: An Interpretable Fact-Checking System with Joint Re-ranking and Veracity Prediction

FactLens: Benchmarking Fine-Grained Fact Verification

Augmenting the Veracity and Explanations of Complex Fact Checking via Iterative Self-Revision with LLMs

Prompt to be Consistent is Better than Self-Consistent? Few-Shot and Zero-Shot Fact Verification with Pre-trained Language Models

Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Models

Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments

Logically at Factify 2022: Multimodal Fact Verification

FactLLaMA: Optimizing Instruction-Following Language Models with External Knowledge for Automated Fact-Checking