Abstract:Natural language to SQL (NL2SQL) techniques provide a convenient interface to access databases, especially for non-expert users, to conduct various data analytics. Existing methods often employ either a rule-base approach or a deep learning based solution. The former is hard to generalize across different domains. Though the latter generalizes well, it often results in queries with syntactic or semantic errors, thus may be even not executable. In this work, we bridge the gap between the two and design a new framework to significantly improve both accuracy and runtime. In particular, we develop a novel CatSQL sketch, which constructs a template with slots that initially serve as placeholders, and tightly integrates with a deep learning model to fill in these slots with meaningful contents based on the database schema. Compared with the widely used sequence-to-sequence-based approaches, our sketch-based method does not need to generate keywords which are boilerplates in the template, and can achieve better accuracy and run much faster. Compared with the existing sketch-based approaches, our CatSQL sketch is more general and versatile, and can leverage the values already filled in on certain slots to derive the rest ones for improved performance. In addition, we propose the Semantics Correction technique, which is the first that leverages database domain knowledge in a deep learning based NL2SQL solution. Semantics Correction is a post-processing routine, which checks the initially generated SQL queries by applying rules to identify and correct semantic errors. This technique significantly improves the NL2SQL accuracy. We conduct extensive evaluations on both single-domain and cross-domain benchmarks and demonstrate that our approach significantly outperforms the previous ones in terms of both accuracy and throughput. In particular, on the state-of-the-art NL2SQL benchmark Spider, our CatSQL prototype outperforms the best of the previous solutions by 4 points on accuracy, while still achieving a throughput up to 63 times higher.

The Processing and Improvement of Multi-Statement Queries in Chiql

Design of Graphical Interface Based on Multidatabase Query Optimization

Query grouping-based multi-query optimization framework for interactive SQL query engines on Hadoop.

CHIQ: Contextual History Enhancement for Improving Query Rewriting in Conversational Search

Multi-SQL: An extensible multi-model data query language

Application of Micro-specialization to Query Evaluation Operators

SAQP++: Bridging the Gap Between Sampling-Based Approximate Query Processing and Aggregate Precomputation.

CHASE-SQL: Multi-Path Reasoning and Preference Optimized Candidate Selection in Text-to-SQL

MoMQ: Mixture-of-Experts Enhances Multi-Dialect Query Generation across Relational and Non-Relational Databases

AQP++: Connecting Approximate Query Processing with Aggregate Precomputation for Interactive Analytics

MIGA: A Unified Multi-task Generation Framework for Conversational Text-to-SQL

CatSQL: Towards Real World Natural Language to SQL Applications.

Adaptive Multi-join Query Processing in PDBMS

Cooperative SQL Generation for Segmented Databases By Using Multi-functional LLM Agents

Scalable Multi-grained Cross-modal Similarity Query with Interpretability

PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency

QDA-SQL: Questions Enhanced Dialogue Augmentation for Multi-Turn Text-to-SQL

XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL

Towards Unified Ad-Hoc Data Processing

Optimization for Collecting and Scoring Documents for Complex Boolean Query

MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generation