Abstract:Configuration tuning is vital to optimize the performance of a database management system (DBMS). It becomes more tedious and urgent for cloud databases (CDB) due to diverse database instances and query workloads, which make the job of a database administrator (DBA) very difficult. Existing solutions for automatic DBMS configuration tuning have several limitations. Firstly, they adopt a pipelined learning model but cannot optimize the overall performance in an end-to-end manner. Secondly, they rely on large-scale high-quality training samples which are hard to obtain. Thirdly, existing approaches cannot recommend reasonable configurations for a large number of knobs to tune whose potential values live in such high-dimensional continuous space. Lastly, in cloud environments, existing approaches can hardly cope with the changes of hardware configurations and workloads, and have poor adaptability. To address these challenges, we design an end-to-end automatic CDB tuning system, CDBTune + , using deep reinforcement learning (RL). CDBTune + utilizes the deep deterministic policy gradient method to find the optimal configurations in a high-dimensional continuous space. CDBTune + adopts a trial-and-error strategy to learn knob settings with a limited number of samples to accomplish the initial training, which alleviates the necessity of collecting a massive amount of high-quality samples. CDBTune + adopts the reward-feedback mechanism in RL instead of traditional regression, which enables end-to-end learning and accelerates the convergence speed of our model and improves the efficiency of online tuning. Besides, we propose effective techniques to improve the training and tuning efficiency of CDBTune + for practical usage in a cloud environment. We conducted extensive experiments under 7 different workloads on real cloud databases to evaluate CDBTune + . Experimental results showed that CDBTune + adapts well to a new hardware environment or workload, and significantly outperformed the state-of-the-art tuning tools and DBA experts.

ResTune: Resource Oriented Tuning Boosted by Meta-Learning for Cloud Databases

CDBTune^+ : an Efficient Deep Reinforcement Learning-Based Automatic Cloud Database Tuning System

An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning

Towards Dynamic and Safe Configuration Tuning for Cloud Databases

WATuning: A Workload-Aware Tuning System with Attention-Based Deep Reinforcement Learning

BestConfig: Tapping the Performance Potential of Systems Via Automatic Configuration Tuning

HUNTER: an Online Cloud Database Hybrid Tuning System for Personalized Requirements

Enhancing Online Index Tuning with a Learned Tuning Diagnostic.

Metis: Robustly Optimizing Tail Latencies Of Cloud Systems

XTuning: Expert Database Tuning System Based on Reinforcement Learning

Industry Practice of Configuration Auto-Tuning for Cloud Applications and Services.

QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning.

Correlation Expert Tuning System for Performance Acceleration

Towards Online and Safe Configuration Tuning with Semi-supervised Anomaly Detection

MLETune: Streamlining Database Knob Tuning Via Multi-LLMs Experts Guided Deep Reinforcement Learning

LLMTune: Accelerate Database Knob Tuning with Large Language Models

Parameters tuning of multi-model database based on deep reinforcement learning

iBTune: Individualized Buffer Tuning for Large-scale Cloud Databases

Automatic Configuration Tuning on Cloud Database: A Survey

A Unified and Efficient Coordinating Framework for Autonomous DBMS Tuning

SpotTune: Leveraging Transient Resources for Cost-efficient Hyper-parameter Tuning in the Public Cloud