Abstract:Modern database management systems (DBMS) expose hundreds of configurable knobs to control system behaviours. Determining the appropriate values for these knobs to improve DBMS performance is a long-standing problem in the database community. As there is an increasing number of knobs to tune and each knob could be in continuous or categorical values, manual tuning becomes impractical. Recently, automatic tuning systems using machine learning methods have shown great potentials. However, existing approaches still incur significant tuning costs or only yield sub-optimal performance. This is because they either ignore the extensive domain knowledge available (e.g., DBMS manuals and forum discussions) and only rely on the runtime feedback of benchmark evaluations to guide the optimization, or they utilize the domain knowledge in a limited way. Hence, we propose GPTuner, a manual-reading database tuning system. Firstly, we develop a Large Language Model (LLM)-based pipeline to collect and refine heterogeneous knowledge, and propose a prompt ensemble algorithm to unify a structured view of the refined knowledge. Secondly, using the structured knowledge, we (1) design a workload-aware and training-free knob selection strategy, (2) develop a search space optimization technique considering the value range of each knob, and (3) propose a Coarse-to-Fine Bayesian Optimization Framework to explore the optimized space. Finally, we evaluate GPTuner under different benchmarks (TPC-C and TPC-H), metrics (throughput and latency) as well as DBMS (PostgreSQL and MySQL). Compared to the state-of-the-art approaches, GPTuner identifies better configurations in 16x less time on average. Moreover, GPTuner achieves up to 30% performance improvement (higher throughput or lower latency) over the best-performing alternative.

Design and Practice of Performance Tuning Experiments in the Course of Database System Principles

Schema-Driven Performance Evaluation for Highly Concurrent Scenarios.

Study on Designing Experiment Teaching Supporting Electrical Equipment Course

Elaborately Programming,carefully Illuming and Studiously Cultivating:Reform and Practice in the Experiment Teaching of Electric Circuit Principle

Development and Practice of Sustainable Experiment Project in Cross Courses

Facilitating Database Tuning with Hyper-Parameter Optimization: a Comprehensive Experimental Evaluation

Reform and practice of undergraduates' experiment teaching management

Reform and Exploration in Principle and Interface Technology of Microprocessors Course Experimental Teaching

Survey on performance optimization for database systems

An Approach of Performance Evaluation in Authentic Database Applications

Designed Experiment and the Improving of Practical Skill for Students

Facilitating Database Tuning with Hyper-Parameter Optimization

A demonstration of the ottertune automatic database management system tuning service

The Exploration and Innovation on Basic Computer Experiment Teaching in University

Improving Comprehensive and Designing Experiment Examining Method, Enhancing Student's Experiment Ability

Design and Practice of Project-Case Teaching Mode in "database Principles"

GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization

The Exploration for Computer System Capacity Training in Experimental Teaching

Design of Simulation Software for Experiments with Visual Basic

The Innovative Practice System of BME Program at Zhejiang University

Research on Performance Optimization of MySQL Database