Abstract:Due to the concise and structured nature of tables, the knowledge contained therein may be incomplete or missing, posing a significant challenge for table question answering (TableQA) and data analysis systems. Most existing datasets either fail to address the issue of external knowledge in TableQA or only utilize unstructured text as supplementary information for tables. In this paper, we propose to use a knowledge base (KB) as the external knowledge source for TableQA and construct a dataset KET-QA with fine-grained gold evidence annotation. Each table in the dataset corresponds to a sub-graph of the entire KB, and every question requires the integration of information from both the table and the sub-graph to be answered. To extract pertinent information from the vast knowledge sub-graph and apply it to TableQA, we design a retriever-reasoner structured pipeline model. Experimental results demonstrate that our model consistently achieves remarkable relative performance improvements ranging from 1.9 to 6.5 times and absolute improvements of 11.66% to 44.64% on EM scores across three distinct settings (fine-tuning, zero-shot, and few-shot), in comparison with solely relying on table information in the traditional TableQA manner. However, even the best model achieves a 60.23% EM score, which still lags behind the human-level performance, highlighting the challenging nature of KET-QA for the question-answering community. We also provide a human evaluation of error cases to analyze further the aspects in which the model can be improved. Project page:

Event-QA: A Dataset for Event-Centric Question Answering over Knowledge Graphs

What is in the KGQA Benchmark Datasets? Survey on Challenges in Datasets for Question Answering on Knowledge Graphs

KET-QA: A Dataset for Knowledge Enhanced Table Question Answering

EventKG: A Multilingual Event-Centric Temporal Knowledge Graph

Leveraging Knowledge Graph for Open-Domain Question Answering

KBQA: Learning Question Answering over QA Corpora and Knowledge Bases

Knowledge Graph-based Question Answering with Electronic Health Records

What is Event Knowledge Graph: A Survey

Question Answering Over Spatio-Temporal Knowledge Graph

A Universal Question-Answering Platform for Knowledge Graphs

TempoQR: Temporal Question Reasoning over Knowledge Graphs

No One is Perfect: Analysing the Performance of Question Answering Components over the DBpedia Knowledge Graph

Introduction to neural network‐based question answering over knowledge graphs

Temporal Knowledge Graph Question Answering: A Survey

Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation

Hybrid-SQuAD: Hybrid Scholarly Question Answering Dataset

Simple Question Answering over Knowledge Graph Enhanced by Question Pattern Classification

KVQA: Knowledge-Aware Visual Question Answering

AutoKG: Constructing Virtual Knowledge Graphs from Unstructured Documents for Question Answering