Abstract:Join order selection (JOS) the problem of finding the optimal join order for an SQL query is a primary focus of database query optimizers. The problem is hard due to its large solution space. Exhaustively traversing the solution space is prohibitively expensive, which is often combined with heuristic pruning. Despite decades-long effort, traditional optimizers still suffer from low scalability or low accuracy when handling complicated SQL queries. Recent attempts using deep reinforcement learning (DRL), by encoding join trees with fixed-length hand-tuned feature vectors, have shed some light on JOS. However, using fixed-length feature vectors cannot capture the structural information of a join tree, which may produce poor join plans. Moreover, it may also cause retraining the neural network when handling schema changes (e.g., adding tables/columns) or multialias table names that are common in SQL queries. In this paper, we present RTOS, a novel learned optimizer that uses Reinforcement learning with Tree-structured long shortterm memory (LSTM) for join Order Selection. RTOS improves existing DRL-based approaches in two main aspects: (1) it adopts graph neural networks to capture the structures of join trees; and (2) it well supports the modification of database schema and multi-alias table names. Extensive experiments on Join Order Benchmark (JOB) and TPC-H show that RTOS outperforms traditional optimizers and existing DRL-based learned optimizers. In particular, the plan RTOS generated for JOB is 101% on (estimated) cost and 67% on latency (i.e., execution time) on average, compared with dynamic programming that is known to produce the state-of-the-art results on join plans.

JSRT: James-Stein Regression Tree

Sparse Residual Tree and Forest.

PS-Tree: A piecewise symbolic regression tree

Gradient Boosting Regression Tree for Traffic Flow Prediction Considering Temporal and Spatial Correlations

Extrapolated Random Tree for Regression

Optimal Sparse Regression Trees

SDTR: Soft Decision Tree Regressor for Tabular Data

Regression trees for longitudinal and multiresponse data

Stochastic tree ensembles for regularized nonlinear regression

Efficient Decision Trees for Tensor Regressions

Neural Regression Trees.

Riemann-Lebesgue Forest for Regression

Quantile Regression Tree

Partitioning Structure Learning for Segmented Linear Regression Trees.

Reinforcement Learning with Tree-LSTM for Join Order Selection

Decision trees using local support vector regression models for large datasets

Treeging

Hierarchical Fuzzy Regression Tree: A New Gradient Boosting Approach to Design a TSK Fuzzy Model

TreeLSTM: A spatiotemporal machine learning model for rainfall-runoff estimation

Improving Uncertainty Quantification of Variance Networks by Tree-Structured Learning

Analysis of Regression Tree Fitting Algorithms in Learning to Rank