Abstract:Fact verification has attracted a lot of research attention recently, e.g., in journalism, marketing, and policymaking, as misinformation and disinformation online can sway one's opinion and affect one's actions. While fact-checking is a hard task in general, in many cases, false statements can be easily debunked based on analytics over tables with reliable information. Hence, table-based fact verification has recently emerged as an important and growing research area. Yet, progress has been limited due to the lack of datasets that can be used to pre-train language models (LMs) to be aware of common table operations, such as aggregating a column or comparing tuples. To bridge this gap, in this paper we introduce PASTA, a novel state-of-the-art framework for table-based fact verification via pre-training with synthesized sentence-table cloze questions. In particular, we design six types of common sentence-table cloze tasks, including Filter, Aggregation, Superlative, Comparative, Ordinal, and Unique, based on which we synthesize a large corpus consisting of 1.2 million sentence-table pairs from WikiTables. PASTA uses a recent pre-trained LM, DeBERTaV3, and further pretrains it on our corpus. Our experimental results show that PASTA achieves new state-of-the-art performance on two table-based fact verification benchmarks: TabFact and SEM-TAB-FACTS. In particular, on the complex set of TabFact, which contains multiple operations, PASTA largely outperforms the previous state of the art by 4.7 points (85.6% vs. 80.9%), and the gap between PASTA and human performance on the small TabFact test set is narrowed to just 1.5 points (90.6% vs. 92.1%).

Table Fact Verification with Structure-Aware Transformer

Local-to-Global Structure-Aware Transformer for Question Answering over Structured Knowledge.

Enhancing Structured Evidence Extraction for Fact Verification

LogicalFactChecker: Leveraging Logical Operations for Fact Checking with Graph Module Network

PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training

Solving Table-based Fact Verification with Mixture of Logical Reasoning

Learn to Combine Linguistic and Symbolic Information for Table-based Fact Verification.

Learning Latent Variable for Logical Reasoning in Table-Based Fact Verification

Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model

Table-based Fact Verification with Self-adaptive Mixture of Experts

Structure-aware Pre-training for Table Understanding with Tree-based Transformers

Structure-aware Pre-training for Table Understanding with Tree-based Transformers.

TableFormer: Table Structure Understanding with Transformers

Logic-level Evidence Retrieval and Graph-based Verification Network for Table-based Fact Verification

MATE: Multi-view Attention for Table Transformer Efficiency

Volta at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables using TAPAS and Transfer Learning

TUTA: Tree-based Transformers for Generally Structured Table Pre-training

A Multi-Level Attention Model for Evidence-Based Fact Checking

SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)

Dual-Channel Evidence Fusion for Fact Verification over Texts and Tables

Program Enhanced Fact Verification with Verbalization and Graph Attention Network