Abstract:PDF HTML XML Export Cite reminder AlphaQO: Robust Learned Query Optimizer DOI: 10.21655/ijsi.1673-7288.00275 Author: Affiliation: Clc Number: Fund Project: National Natural Science Foundation of China (61925205,61632016), Huawei, and TAL Article | Figures | Metrics | Reference | Related | Cited by | Materials | Comments Abstract:Recently, learned query optimizers typically driven by deep learning models have attracted wide attention as they can offer similar or even better performance than state-of-the-art commercial optimizers. A successful learning optimizer often relies on enough high-quality load queries as training data, and poor-quality training will lead to the query failure of learned query optimizers. In this paper, we propose a novel training framework AlphaQO for robust learned query optimizers based on Reinforcement Learning (RL), and the robustness of the optimizers can be improved by finding the bad queries in advance. AlphaQO is a loop system consisting of two main components, namely the query generator and the learned optimizer. A query generator aims at generating ``difficult'' queries (i.e., queries that the learned optimizer provides poor estimates). The learned optimizer will be trained using these generated queries, as well as providing feedback (in terms of numerical rewards) to the query generator for updates. If the generated queries are good, the query generator will get a high reward; otherwise, the query generator will get a low reward. The above process is performed iteratively, with the main goal that within a small budget, the learned optimizer can be trained and generalized well to a wide range of unseen queries. Extensive experiments show that AlphaQO can generate a relatively small number of queries and train a learned optimizer to outperform commercial optimizers. Moreover, learned optimizers require much fewer queries from AlphaQO than randomly generated queries for the quality training of the learned optimizer. Reference Related Cited by

FOSS: A Self-Learned Doctor for Query Optimizer

Join Query Optimization with Deep Reinforcement Learning Algorithms

LOGER: A Learned Optimizer Towards Generating Efficient and Robust Query Execution Plans

Learned Query Optimizers: Evaluation and Improvement

gFOV: A Full-Stack SPARQL Query Optimizer & Plan Visualizer

Learning to Optimize Join Queries With Deep Reinforcement Learning

GLO: Towards Generalized Learned Query Optimization

Lero: applying learning-to-rank in query optimizer

SOFA: An Extensible Logical Optimizer for UDF-heavy Dataflows

Reinforcement Learning with Tree-LSTM for Join Order Selection

AlphaQO: Robust Learned Query Optimizer

GOSH: Task Scheduling Using Deep Surrogate Models in Fog Computing Environments

A latency and fault-tolerance optimizer for online parallel query plans

Learned Query Optimization by Constraint-Based Query Plan Augmentation

OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations

FLOPS: Forward Learning with OPtimal Sampling

Efficient Query Re-optimization with Judicious Subquery Selections

Opengauss

Deep Symbolic Optimization for Combinatorial Optimization: Accelerating Node Selection by Discovering Potential Heuristics

COOOL: A Learning-To-Rank Approach for SQL Hint Recommendations

RLO: a Reinforcement Learning-Based Method for Join Optimization