Abstract:Knob tuning plays an important role in database optimization, which tunes knob settings to optimize the database performance or improve resource utilization. However, there are several common challenges in knob tuning. First, databases have hundreds of configuration knobs, and it is hard to determine the knobs that cause the performance/resource bottlenecks. Second, most knobs are of continuous values and cause large search space, where heuristic knob tuning may not find high-performance knob settings within limited time. Third, it is increasingly tricky to conduct knob tuning with the proliferation of cloud services, where we need to tune a large number of database instances for various scenarios (e.g., different applications, datasets, and hardware). Recently, many learning-based knob tuning methods are proposed to alleviate those problems. The core idea of learning-based knob tuning is that, with the help of machine learning techniques, it is reasonable to collect knob tuning data, leverage these data to train a knob tuning model, and utilize the tuning model to recommend knob settings for new similar scenarios, so as to achieve the optimization objectives. In this paper, we provide a comprehensive survey on database knob tuning. The pipeline of knob tuning includes knob selection , feature selection , tuning methods , and transfer techniques . First, for knob selection , we introduce the main categories of database knobs and summarize existing knob selection algorithms. Second, for feature selection , we introduce commonly-used tuning features and explain existing feature selection techniques (e.g., runtime metric selection and workload encoding). Third, for tuning methods , we compare four classes of tuning methods, i.e., heuristic methods, Bayesian-optimization methods, deep-learning methods, and reinforcement-learning methods. In particular, we summarize the challenges and discuss how existing methods address those challenges. Moreover, we discuss some transfer techniques that utilize historically well-trained tuning models in new scenarios. Fourth, we discuss the implementation of automatic knob tuning methods in typical systems (e.g., commercial relational databases and Big Data analytics systems). Lastly, we provide some research challenges and future research opportunities. We believe this survey can help researchers better understand the knob tuning problems and existing approaches and further encourage them to solve the remaining problems in automatic knob tuning.

Is Large Language Model Good at Database Knob Tuning? A Comprehensive Experimental Evaluation

LLMTune: Accelerate Database Knob Tuning with Large Language Models

DB-GPT: Large Language Model Meets Database

λ-Tune: Harnessing Large Language Models for Automated Database System Tuning

LATuner: an LLM-Enhanced Database Tuning System Based on Adaptive Surrogate Model

MLETune: Streamlining Database Knob Tuning Via Multi-LLMs Experts Guided Deep Reinforcement Learning

A Demonstration of GPTuner: A GPT-Based Manual-Reading Database Tuning System

Enhancing Large Language Model Performance To Answer Questions and Extract Information More Accurately

GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization

Fine Tuning LLM for Enterprise: Practical Guidelines and Recommendations

A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testing

Studying and Benchmarking Large Language Models For Log Level Suggestion

The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunities

Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilities

LLM As DBA

LLM4DS: Evaluating Large Language Models for Data Science Code Generation

Automatic Database Knob Tuning: A Survey

Challenges and Contributing Factors in the Utilization of Large Language Models (LLMs)

Fine-Tuning or Fine-Failing? Debunking Performance Myths in Large Language Models

Exploring the True Potential: Evaluating the Black-box Optimization Capability of Large Language Models

Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study