Abstract:Misinformation threatens modern society by promoting distrust in science, changing narratives in public health, heightening social polarization, and disrupting democratic elections and financial markets, among a myriad of other societal harms. To address this, a growing cadre of professional fact-checkers and journalists provide high-quality investigations into purported facts. However, these largely manual efforts have struggled to match the enormous scale of the problem. In response, a growing body of Natural Language Processing (NLP) technologies have been proposed for more scalable fact-checking. Despite tremendous growth in such research, however, practical adoption of NLP technologies for fact-checking still remains in its infancy today. In this work, we review the capabilities and limitations of the current NLP technologies for fact-checking. Our particular focus is to further chart the design space for how these technologies can be harnessed and refined in order to better meet the needs of human fact-checkers. To do so, we review key aspects of NLP-based fact-checking: task formulation, dataset construction, modeling, and human-centered strategies, such as explainable models and human-in-the-loop approaches. Next, we review the efficacy of applying NLP-based fact-checking tools to assist human fact-checkers. We recommend that future research include collaboration with fact-checker stakeholders early on in NLP research, as well as incorporation of human-centered design practices in model development, in order to further guide technology development for human use and practical adoption. Finally, we advocate for more research on benchmark development supporting extrinsic evaluation of human-centered fact-checking technologies.

Zero-Shot Learning and Key Points Are All You Need for Automated Fact-Checking

Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphs

Zero-Shot Fact Verification via Natural Logic and Large Language Models

The State of Human-centered NLP Technology for Fact-checking

FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

Automated Fact Checking: Task formulations, methods and future directions

FAKTA: an Automatic End-to-End Fact Checking System

Automated Fact-Checking for Assisting Human Fact-Checkers

Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers

Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models

LRQ-Fact: LLM-Generated Relevant Questions for Multimodal Fact-Checking

Generating Scientific Claims for Zero-Shot Scientific Fact Checking

Evidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMs

The perils and promises of fact-checking with large language models

ZeFaV: Boosting Large Language Models for Zero-shot Fact Verification

Fact Checking Beyond Training Set

SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning

Fully Automated Fact Checking Using External Sources

FactFinders at CheckThat! 2024: Refining Check-worthy Statement Detection with LLMs through Data Pruning

The Perils & Promises of Fact-checking with Large Language Models

ZeroKey: Point-Level Reasoning and Zero-Shot 3D Keypoint Detection from Large Language Models