Abstract:Combating disinformation is one of the burning societal crises -- about 67% of the American population believes that disinformation produces a lot of uncertainty, and 10% of them knowingly propagate disinformation. Evidence shows that disinformation can manipulate democratic processes and public opinion, causing disruption in the share market, panic and anxiety in society, and even death during crises. Therefore, disinformation should be identified promptly and, if possible, mitigated. With approximately 3.2 billion images and 720,000 hours of video shared online daily on social media platforms, scalable detection of multimodal disinformation requires efficient fact verification. Despite progress in automatic text-based fact verification (e.g., FEVER, LIAR), the research community lacks substantial effort in multimodal fact verification. To address this gap, we introduce FACTIFY 3M, a dataset of 3 million samples that pushes the boundaries of the domain of fact verification via a multimodal fake news dataset, in addition to offering explainability through the concept of 5W question-answering. Salient features of the dataset include: (i) textual claims, (ii) ChatGPT-generated paraphrased claims, (iii) associated images, (iv) stable diffusion-generated additional images (i.e., visual paraphrases), (v) pixel-level image heatmap to foster image-text explainability of the claim, (vi) 5W QA pairs, and (vii) adversarial fake news stories.

Team Trifecta at Factify5WQA: Setting the Standard in Fact Verification with Fine-Tuning

INO at Factify 2: Structure Coherence based Multi-Modal Fact Verification

Overview of Factify5WQA: Fact Verification through 5W Question-Answering

Logically at Factify 2022: Multimodal Fact Verification

Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers

FACTIFY3M: A Benchmark for Multimodal Fact Verification with Explainability through 5W Question-Answering

FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

Unsupervised Pretraining for Fact Verification by Language Model Distillation

FactLens: Benchmarking Fine-Grained Fact Verification

Findings of Factify 2: Multimodal Fake News Detection

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models

FAKTA: an Automatic End-to-End Fact Checking System

FactAlign: Long-form Factuality Alignment of Large Language Models

Connecting the Dots Between Fact Verification and Fake News Detection

Program Enhanced Fact Verification with Verbalization and Graph Attention Network

Language Models Hallucinate, but May Excel at Fact Verification

FactFinders at CheckThat! 2024: Refining Check-worthy Statement Detection with LLMs through Data Pruning

Fact-Checking Complex Claims with Program-Guided Reasoning

Contrastive Learning to Improve Retrieval for Real-world Fact Checking

Augmenting the Veracity and Explanations of Complex Fact Checking via Iterative Self-Revision with LLMs

Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Models