Abstract:Knob tuning plays an important role in database optimization, which tunes knob settings to optimize the database performance or improve resource utilization. However, there are several common challenges in knob tuning. First, databases have hundreds of configuration knobs, and it is hard to determine the knobs that cause the performance/resource bottlenecks. Second, most knobs are of continuous values and cause large search space, where heuristic knob tuning may not find high-performance knob settings within limited time. Third, it is increasingly tricky to conduct knob tuning with the proliferation of cloud services, where we need to tune a large number of database instances for various scenarios (e.g., different applications, datasets, and hardware). Recently, many learning-based knob tuning methods are proposed to alleviate those problems. The core idea of learning-based knob tuning is that, with the help of machine learning techniques, it is reasonable to collect knob tuning data, leverage these data to train a knob tuning model, and utilize the tuning model to recommend knob settings for new similar scenarios, so as to achieve the optimization objectives. In this paper, we provide a comprehensive survey on database knob tuning. The pipeline of knob tuning includes knob selection , feature selection , tuning methods , and transfer techniques . First, for knob selection , we introduce the main categories of database knobs and summarize existing knob selection algorithms. Second, for feature selection , we introduce commonly-used tuning features and explain existing feature selection techniques (e.g., runtime metric selection and workload encoding). Third, for tuning methods , we compare four classes of tuning methods, i.e., heuristic methods, Bayesian-optimization methods, deep-learning methods, and reinforcement-learning methods. In particular, we summarize the challenges and discuss how existing methods address those challenges. Moreover, we discuss some transfer techniques that utilize historically well-trained tuning models in new scenarios. Fourth, we discuss the implementation of automatic knob tuning methods in typical systems (e.g., commercial relational databases and Big Data analytics systems). Lastly, we provide some research challenges and future research opportunities. We believe this survey can help researchers better understand the knob tuning problems and existing approaches and further encourage them to solve the remaining problems in automatic knob tuning.

MLETune: Streamlining Database Knob Tuning Via Multi-LLMs Experts Guided Deep Reinforcement Learning

LLMTune: Accelerate Database Knob Tuning with Large Language Models

LATuner: an LLM-Enhanced Database Tuning System Based on Adaptive Surrogate Model

Is Large Language Model Good at Database Knob Tuning? A Comprehensive Experimental Evaluation

XTuning: Expert Database Tuning System Based on Reinforcement Learning

GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization

Utilizing deep learning for automated tuning of database management systems

λ-Tune: Harnessing Large Language Models for Automated Database System Tuning

QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning.

Parameters tuning of multi-model database based on deep reinforcement learning

Deep learning based Auto Tuning for Database Management System

Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs

LMTuner: An user-friendly and highly-integrable Training Framework for fine-tuning Large Language Models

ResTune: Resource Oriented Tuning Boosted by Meta-Learning for Cloud Databases

Automatic Database Knob Tuning: A Survey

An inquiry into machine learning-based automatic configuration tuning services on real-world database management systems

EMIT: Micro-Invasive Database Configuration Tuning

Adaptive Code Learning for Spark Configuration Tuning

From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning

Correlation Expert Tuning System for Performance Acceleration

Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Delta Tuning