Abstract:Natural language to SQL (NL2SQL) techniques provide a convenient interface to access databases, especially for non-expert users, to conduct various data analytics. Existing methods often employ either a rule-base approach or a deep learning based solution. The former is hard to generalize across different domains. Though the latter generalizes well, it often results in queries with syntactic or semantic errors, thus may be even not executable. In this work, we bridge the gap between the two and design a new framework to significantly improve both accuracy and runtime. In particular, we develop a novel CatSQL sketch, which constructs a template with slots that initially serve as placeholders, and tightly integrates with a deep learning model to fill in these slots with meaningful contents based on the database schema. Compared with the widely used sequence-to-sequence-based approaches, our sketch-based method does not need to generate keywords which are boilerplates in the template, and can achieve better accuracy and run much faster. Compared with the existing sketch-based approaches, our CatSQL sketch is more general and versatile, and can leverage the values already filled in on certain slots to derive the rest ones for improved performance. In addition, we propose the Semantics Correction technique, which is the first that leverages database domain knowledge in a deep learning based NL2SQL solution. Semantics Correction is a post-processing routine, which checks the initially generated SQL queries by applying rules to identify and correct semantic errors. This technique significantly improves the NL2SQL accuracy. We conduct extensive evaluations on both single-domain and cross-domain benchmarks and demonstrate that our approach significantly outperforms the previous ones in terms of both accuracy and throughput. In particular, on the state-of-the-art NL2SQL benchmark Spider, our CatSQL prototype outperforms the best of the previous solutions by 4 points on accuracy, while still achieving a throughput up to 63 times higher.

DuoRAT: Towards Simpler Text-to-SQL Models

CatSQL: Towards Real World Natural Language to SQL Applications.

mRAT-SQL+GAP:A Portuguese Text-to-SQL Transformer

$R^3$: "This is My SQL, Are You With Me?" A Consensus-Based Multi-Agent System for Text-to-SQL Tasks

RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL

Deep Learning Driven Natural Languages Text to SQL Query Conversion: A Survey

Evaluating the Data Model Robustness of Text-to-SQL Systems Based on Real User Queries

Bertrand-DR: Improving Text-to-SQL using a Discriminative Re-ranker

Weakly Supervised Text-to-SQL Parsing through Question Decomposition

RGISQL: Integrating Refined Grammatical Information into Relational Graph Neural Network for Text-to-SQL Task

R2D2: Relational Text Decoding with Transformers

Improving Retrieval-augmented Text-to-SQL with AST-based Ranking and Schema Pruning

SV2-SQL: a text-to-SQL transformation mechanism based on BERT models for slot filling, value extraction, and verification

Text2SQL is Not Enough: Unifying AI and Databases with TAG

RH-SQL: Refined Schema and Hardness Prompt for Text-to-SQL

RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases

Data Transformation to Construct a Dataset for Generating Entity-Relationship Model from Natural Language

UniSAr: a unified structure-aware autoregressive language model for text-to-SQL semantic parsing

CodeS: Towards Building Open-source Language Models for Text-to-SQL

RSL-SQL: Robust Schema Linking in Text-to-SQL Generation

A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directions