Abstract:PDF HTML XML Export Cite reminder AlphaQO: Robust Learned Query Optimizer DOI: 10.21655/ijsi.1673-7288.00275 Author: Affiliation: Clc Number: Fund Project: National Natural Science Foundation of China (61925205,61632016), Huawei, and TAL Article | Figures | Metrics | Reference | Related | Cited by | Materials | Comments Abstract:Recently, learned query optimizers typically driven by deep learning models have attracted wide attention as they can offer similar or even better performance than state-of-the-art commercial optimizers. A successful learning optimizer often relies on enough high-quality load queries as training data, and poor-quality training will lead to the query failure of learned query optimizers. In this paper, we propose a novel training framework AlphaQO for robust learned query optimizers based on Reinforcement Learning (RL), and the robustness of the optimizers can be improved by finding the bad queries in advance. AlphaQO is a loop system consisting of two main components, namely the query generator and the learned optimizer. A query generator aims at generating ``difficult'' queries (i.e., queries that the learned optimizer provides poor estimates). The learned optimizer will be trained using these generated queries, as well as providing feedback (in terms of numerical rewards) to the query generator for updates. If the generated queries are good, the query generator will get a high reward; otherwise, the query generator will get a low reward. The above process is performed iteratively, with the main goal that within a small budget, the learned optimizer can be trained and generalized well to a wide range of unseen queries. Extensive experiments show that AlphaQO can generate a relatively small number of queries and train a learned optimizer to outperform commercial optimizers. Moreover, learned optimizers require much fewer queries from AlphaQO than randomly generated queries for the quality training of the learned optimizer. Reference Related Cited by

Eraser: Eliminating Performance Regression on Learned Query Optimizer.

Lero: applying learning-to-rank in query optimizer

Lero: A Learning-to-Rank Query Optimizer.

LOGER: A Learned Optimizer Towards Generating Efficient and Robust Query Execution Plans

Robust Listwise Learning-to-Rank Approach for Database Query Optimizer

ERASER: Machine Unlearning in MLaaS via an Inference Serving-Aware Approach

LEON: A New Framework for ML-Aided Query Optimization.

Learned Query Optimizer: What is New and What is Next

Learned Query Optimizers: Evaluation and Improvement

BitE : Accelerating Learned Query Optimization in a Mixed-Workload Environment

LMEraser: Large Model Unlearning through Adaptive Prompt Tuning

DeepO: A Learned Query Optimizer

AlphaQO: Robust Learned Query Optimizer

Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection

Balsa: Learning a Query Optimizer Without Expert Demonstrations

Towards Exploratory Query Optimization for Template-Based SQL Workloads

Learned Optimizer for Online Approximate Query Processing in Data Exploration

The Unreasonable Effectiveness of LLMs for Query Optimization

Query Optimization for Parametric Knowledge Refinement in Retrieval-Augmented Large Language Models

Rover: An online Spark SQL tuning service via generalized transfer learning

Roq: Robust Query Optimization Based on a Risk-aware Learned Cost Model