Abstract:In today's fast-paced industry, professionals face the challenge of summarizing a large number of documents and extracting vital information from them on a daily basis. These metrics are frequently hidden away in tables and/or their nested hyperlinks. To address this challenge, the approach of Table Question Answering (QA) has been developed to extract the relevant information. However, traditional Table QA training tasks that provide a table and an answer(s) from a gold cell coordinate(s) for a question may not always ensure extracting the accurate answer(s). Recent advancements in Large Language Models (LLMs) have opened up new possibilities for extracting information from tabular data using prompts. In this paper, we introduce the Multi-hop Few-shot Open Rich Table QA (MFORT-QA) approach, which consists of two major steps. The first step involves Few-Shot Learning (FSL), where relevant tables and associated contexts of hyperlinks are retrieved based on a given question. The retrieved content is then used to construct few-shot prompts as inputs to an LLM, such as ChatGPT. To tackle the challenge of answering complex questions, the second step leverages Chain-of-thought (CoT) prompting to decompose the complex question into a sequential chain of questions and reasoning thoughts in a multi-hop manner. Retrieval-Augmented Generation (RAG) enhances this process by retrieving relevant tables and contexts of hyperlinks that are relevant to the resulting reasoning thoughts and questions. These additional contexts are then used to supplement the prompt used in the first step, resulting in more accurate answers from an LLM. Empirical results from OTT-QA demonstrate that our abstractive QA approach significantly improves the accuracy of extractive Table QA methods.

Multi-Hop Table Retrieval for Open-Domain Text-to-SQL.

MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQL

Domain-specific Cross-Language Relevant Question Retrieval.

Retrieval Augmented Via Execution Guidance in Open-domain Table QA

Is Table Retrieval a Solved Problem? Exploring Join-Aware Multi-Table Retrieval

Enhancing Open-Domain Table Question Answering via Syntax- and Structure-aware Dense Retrieval

Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answering

Text Reasoning Chain Extraction for Multi-Hop Question Answering

S$^3$HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

EfficientRAG: Efficient Retriever for Multi-Hop Question Answering

MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answering

TCSR-SQL: Towards Table Content-aware Text-to-SQL with Self-retrieval

Towards Text-to-SQL over Aggregate Tables

M3: A Multi-Task Mixed-Objective Learning Framework for Open-Domain Multi-Hop Dense Sentence Retrieval

Schema-Aware Multi-Task Learning for Complex Text-to-SQL

Content-Based Table Retrieval for Web Queries

Multi-Meta-RAG: Improving RAG for Multi-Hop Queries using Database Filtering with LLM-Extracted Metadata

Dense Hierarchical Retrieval for Open-Domain Question Answering

Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach

Mutually improved dense retriever and GNN-based reader for arbitrary-hop open-domain question answering