Abstract:In recent years, a wide spectrum of database tuning systems have emerged to automatically optimize database performance. However, these systems require a significant number of workload runs to deliver a satisfactory level of database performance, which is time-consuming and resource-intensive. While many attempts have been made to address this issue by using advanced search optimizers, empirical studies have shown that no single optimizer can dominate the rest across tuning tasks with different characteristics. Choosing an inferior optimizer may significantly increase the tuning cost. Unfortunately, current practices typically adopt a single optimizer or follow simple heuristics without considering the task characteristics. Consequently, they fail to choose the most suitable optimizer for a specific task. Furthermore, constructing a compact search space can significantly improve the tuning efficiency. However, current practices neglect the setting of the value range for each knob and rely on a large number of workload runs to select important knobs, resulting in a considerable amount of unnecessary exploration in ineffective regions. To pursue efficient database tuning, in this paper, we argue that it is imperative to have an approach that can judiciously determine a precise space and search optimizer for an arbitrary tuning task. To this end, we propose OpAdviser, which exploits the information learned from historical tuning tasks to guide the search space construction and search optimizer selection. Our design can greatly accelerate the tuning process and further reduce the required workload runs. Given a tuning task, OpAdviser learns the geometries of search space, including important knobs and their effective regions, from relevant previous tasks. It then constructs the target search space from the geometries according to the on-the-fly task similarity, which allows for adaptive adjustment of the target space. OpAdviser also employs a pairwise ranking model to capture the relationship from task characteristics to optimizer rankings. This ranking model is invoked during tuning and predicts the best optimizer to be used for the current iteration. We conduct extensive evaluations across a diverse set of workloads, where OpAdviser achieves 9.2% higher throughput and significantly reduces the number of workload runs with an average speedup of ~3.4x compared to state-of-the-art tuning systems.

Explainable Database Management System Configuration Tuning Through Counterfactuals

BestConfig: Tapping the Performance Potential of Systems Via Automatic Configuration Tuning

KnobTune: A Dynamic Database Configuration Tuning Strategy Leveraging Historical Workload Similarities

Facilitating Database Tuning with Hyper-Parameter Optimization: a Comprehensive Experimental Evaluation

Facilitating Database Tuning with Hyper-Parameter Optimization

CDBTune^+ : an Efficient Deep Reinforcement Learning-Based Automatic Cloud Database Tuning System

An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning

Correlation Expert Tuning System for Performance Acceleration

Towards Dynamic and Safe Configuration Tuning for Cloud Databases

An inquiry into machine learning-based automatic configuration tuning services on real-world database management systems

XTuning: Expert Database Tuning System Based on Reinforcement Learning

Utilizing deep learning for automated tuning of database management systems

LLMTune: Accelerate Database Knob Tuning with Large Language Models

GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization

EMIT: Micro-Invasive Database Configuration Tuning

A demonstration of the ottertune automatic database management system tuning service

A Unified and Efficient Coordinating Framework for Autonomous DBMS Tuning

An Efficient Transfer Learning Based Configuration Adviser for Database Tuning

A Demonstration of GPTuner: A GPT-Based Manual-Reading Database Tuning System

Enhancing Online Index Tuning with a Learned Tuning Diagnostic.

Parameters tuning of multi-model database based on deep reinforcement learning