Abstract:This article presents a pipeline for automated fact-checking leveraging publicly available Language Models and data. The objective is to assess the accuracy of textual claims using evidence from a ground-truth evidence corpus. The pipeline consists of two main modules -- the evidence retrieval and the claim veracity evaluation. Our primary focus is on the ease of deployment in various languages that remain unexplored in the field of automated fact-checking. Unlike most similar pipelines, which work with evidence sentences, our pipeline processes data on a paragraph level, simplifying the overall architecture and data requirements. Given the high cost of annotating language-specific fact-checking training data, our solution builds on the Question Answering for Claim Generation (QACG) method, which we adapt and use to generate the data for all models of the pipeline. Our strategy enables the introduction of new languages through machine translation of only two fixed datasets of moderate size. Subsequently, any number of training samples can be generated based on an evidence corpus in the target language. We provide open access to all data and fine-tuned models for Czech, English, Polish, and Slovak pipelines, as well as to our codebase that may be used to reproduce the results.We comprehensively evaluate the pipelines for all four languages, including human annotations and per-sample difficulty assessment using Pointwise V-information. The presented experiments are based on full Wikipedia snapshots to promote reproducibility. To facilitate implementation and user interaction, we develop the FactSearch application featuring the proposed pipeline and the preliminary feedback on its performance.

factgenie: A Framework for Span-based Evaluation of Generated Texts

FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation

Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers

FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios

GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment

FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

Multi-Fact Correction in Abstractive Text Summarization

Beyond Word for Word: Fact Guided Training for Neural Data-to-Document Generation

Learning from Fact-checkers: Analysis and Generation of Fact-checking Language

GLTR: Statistical Detection and Visualization of Generated Text

Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model

Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language

Key Fact as Pivot: A Two-Stage Model for Low Resource Table-to-Text Generation

Long-form factuality in large language models

A Structured Span Selector

Improving Model Factuality with Fine-grained Critique-based Evaluator

Fast and Accurate Factual Inconsistency Detection Over Long Documents

generAItor: Tree-in-the-Loop Text Generation for Language Model Explainability and Adaptation

VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation

FaaF: Facts as a Function for the evaluation of generated text

Evaluating Factual Consistency of Texts with Semantic Role Labeling