Abstract:AI systems that serve natural language questions over databases promise to unlock tremendous value. Such systems would allow users to leverage the powerful reasoning and knowledge capabilities of language models (LMs) alongside the scalable computational power of data management systems. These combined capabilities would empower users to ask arbitrary natural language questions over custom data sources. However, existing methods and benchmarks insufficiently explore this setting. Text2SQL methods focus solely on natural language questions that can be expressed in relational algebra, representing a small subset of the questions real users wish to ask. Likewise, Retrieval-Augmented Generation (RAG) considers the limited subset of queries that can be answered with point lookups to one or a few data records within the database. We propose Table-Augmented Generation (TAG), a unified and general-purpose paradigm for answering natural language questions over databases. The TAG model represents a wide range of interactions between the LM and database that have been previously unexplored and creates exciting research opportunities for leveraging the world knowledge and reasoning capabilities of LMs over data. We systematically develop benchmarks to study the TAG problem and find that standard methods answer no more than 20% of queries correctly, confirming the need for further research in this area. We release code for the benchmark at <a class="link-external link-https" href="https://github.com/TAG-Research/TAG-Bench" rel="external noopener nofollow">this https URL</a>.

Towards Text-to-SQL over Aggregate Tables

SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL

An interaction-modeling mechanism for context-dependent Text-to-SQL translation based on heterogeneous graph aggregation

Schema-Aware Multi-Task Learning for Complex Text-to-SQL

Text2SQL is Not Enough: Unifying AI and Databases with TAG

Exploring Schema Generalizability of Text-to-SQL.

ER-SQL: Learning Enhanced Representation for Text-to-SQL Using Table Contents.

KG-SQL: Hybrid Knowledge-Guided Semantic Understanding for Text-to-SQL

Improving Retrieval-augmented Text-to-SQL with AST-based Ranking and Schema Pruning

A Heterogeneous Graph to Abstract Syntax Tree Framework for Text-to-SQL

RGISQL: Integrating Refined Grammatical Information into Relational Graph Neural Network for Text-to-SQL Task

Enhancing Text-to-SQL Translation for Financial System Design

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

On the Structural Generalization in Text-to-SQL

TCSR-SQL: Towards Table Content-aware Text-to-SQL with Self-retrieval

Text2Analysis: A Benchmark of Table Question Answering with Advanced Data Analysis and Unclear Queries

Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expect

"What Do You Mean by That?" A Parser-Independent Interactive Approach for Enhancing Text-to-SQL.

RH-SQL: Refined Schema and Hardness Prompt for Text-to-SQL

Relation-Aware Graph Transformer for SQL-to-Text Generation

Know What I don’t Know: Handling Ambiguous and Unknown Questions for Text-to-SQL