Abstract:Large Language Models (LLMs) have spurred progress in text-to-SQL, the task of generating SQL queries from natural language questions based on a given database schema. Despite the declarative nature of SQL, it continues to be a complex programming language. In this paper, we investigate the potential of an alternative query language with simpler syntax and modular specification of complex queries. The purpose is to create a query language that can be learned more easily by modern neural semantic parsing architectures while also enabling non-programmers to better assess the validity of the query plans produced by an interactive query plan assistant. The proposed alternative query language is called Query Plan Language (QPL). It is designed to be modular and can be translated into a restricted form of SQL Common Table Expressions (CTEs). The aim of QPL is to make complex data retrieval accessible to non-programmers by allowing users to express their questions in natural language while also providing an easier-to-verify target language. The paper demonstrates how neural LLMs can benefit from QPL's modularity to generate complex query plans in a compositional manner. This involves a question decomposition strategy and a planning stage. We conduct experiments on a version of the Spider text-to-SQL dataset that has been converted to QPL. The hierarchical structure of QPL programs enables us to measure query complexity naturally. Based on this assessment, we identify the low accuracy of existing text-to-SQL systems on complex compositional queries. We present ways to address the challenge of complex queries in an iterative, user-controlled manner, using fine-tuned LLMs and a variety of prompting strategies in a compositional manner.

RECPARSER: A Recursive Semantic Parsing Framework for Text-to-SQL Task

Hierarchical Schema Representation for Text-to-SQL Parsing with Decomposing Decoding

RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL

Improving Semantic Parsing with Neural Generator-Reranker Architecture

SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases.

Semantic Parsing with Syntax- and Table-Aware SQL Generation

Error Detection for Text-to-SQL Semantic Parsing

Relation Aware Semi-autoregressive Semantic Parsing for NL2SQL

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

Semantic Decomposition of Question and SQL for Text-to-SQL Parsing

Semantic Parsing for Complex Data Retrieval: Targeting Query Plans vs. SQL for No-Code Access to Relational Databases

CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parsers

Retrieval-Then-Parsing: A Two-Stage Model for SQL Generation in Financial Domain

A Multiple-Integration Encoder for Multi-Turn Text-to-SQL Semantic Parsing.

A Hybrid Semantic Parsing Approach for Tabular Data Analysis

Improving Retrieval-augmented Text-to-SQL with AST-based Ranking and Schema Pruning

A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directions

SPSQL: Step-by-step Parsing Based Framework for Text-to-SQL Generation

Deep Hierarchical Human Semantic Parsing

ShadowGNN: Graph Projection Neural Network for Text-to-SQL Parser.

QURG: Question Rewriting Guided Context-Dependent Text-to-SQL Semantic Parsing