Abstract:Generative AI appears poised to transform white collar professions, with more than 90% of Fortune 500 companies using OpenAI's flagship GPT models, which have been characterized as "general purpose technologies" capable of effecting epochal changes in the economy. But how will such technologies impact organizations whose job is to verify and report factual information, and to ensure the health of the information ecosystem? To investigate this question, we conducted 30 interviews with N=38 participants working at 29 fact-checking organizations across six continents, asking about how they use generative AI and the opportunities and challenges they see in the technology. We found that uses of generative AI envisioned by fact-checkers differ based on organizational infrastructure, with applications for quality assurance in Editing, for trend analysis in Investigation, and for information literacy in Advocacy. We used the TOE framework to describe participant concerns ranging from the Technological (lack of transparency), to the Organizational (resource constraints), to the Environmental (uncertain and evolving policy). Building on the insights of our participants, we describe value tensions between fact-checking and generative AI, and propose a novel Verification dimension to the design space of generative models for information verification work. Finally, we outline an agenda for fairness, accountability, and transparency research to support the responsible use of generative AI in fact-checking. Throughout, we highlight the importance of human infrastructure and labor in producing verified information in collaboration with AI. We expect that this work will inform not only the scientific literature on fact-checking, but also contribute to understanding of organizational adaptation to a powerful but unreliable new technology.

FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios

Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers

FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation

The Earth is Flat? Unveiling Factual Errors in Large Language Models

Factuality challenges in the era of large language models and opportunities for fact-checking

FAKTA: an Automatic End-to-End Fact Checking System

Staying vigilant in the Age of AI: From content generation to content authentication

Et Machina: Exploring the Use of Conversational Agents Such as ChatGPT in Scientific Writing

FacLens: Transferable Probe for Foreseeing Non-Factuality in Large Language Models

Factuality Enhanced Language Models for Open-Ended Text Generation

An Empirical Study of Using ChatGPT for Fact Verification Task

Long-form factuality in large language models

FaaF: Facts as a Function for the evaluation of generated text

An Empirical Study of AI Generated Text Detection Tools

Automated Claim Matching with Large Language Models: Empowering Fact-Checkers in the Fight Against Misinformation

FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

FACT-GPT: Fact-Checking Augmentation via Claim Matching with LLMs

GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning

The Impact and Opportunities of Generative AI in Fact-Checking

Alexpaca: Learning Factual Clarification Question Generation Without Examples

Face4RAG: Factual Consistency Evaluation for Retrieval Augmented Generation in Chinese