Abstract:Recently using machine learning (ML) based techniques to optimize modern database management systems has attracted intensive interest from both industry and academia. With an objective to tune a specific component of a DBMS (e.g., index selection, knobs tuning), the ML-based tuning agents have shown to be able to find better configurations than experienced database administrators. However, one critical yet challenging question remains unexplored -- how to make those ML-based tuning agents work collaboratively. Existing methods do not consider the dependencies among the multiple agents, and the model used by each agent only studies the effect of changing the configurations in a single component. To tune different components for DBMS, a coordinating mechanism is needed to make the multiple agents cognizant of each other. Also, we need to decide how to allocate the limited tuning budget among the agents to maximize the performance. Such a decision is difficult to make since the distribution of the reward for each agent is unknown and non-stationary. In this paper, we study the above question and present a unified coordinating framework to efficiently utilize existing ML-based agents. First, we propose a message propagation protocol that specifies the collaboration behaviors for agents and encapsulates the global tuning messages in each agent's model. Second, we combine Thompson Sampling, a well-studied reinforcement learning algorithm with a memory buffer so that our framework can allocate budget judiciously in a non-stationary environment. Our framework defines the interfaces adapted to a broad class of ML-based tuning agents, yet simple enough for integration with existing implementations and future extensions. We show that it can effectively utilize different ML-based agents and find better configurations with 1.4~14.1X speedups on the workload execution time compared with baselines.

CoTuner: A Hierarchical Learning Framework for Coordinately Optimizing Resource Partitioning and Parameter Tuning.

COTuner: Joint Optimization of Resource Configuration and Software Parameters for Recurring Streaming Jobs on the Cloud

A Unified and Efficient Coordinating Framework for Autonomous DBMS Tuning

Compiler Autotuning through Multiple Phase Learning

ContTune: Continuous Tuning by Conservative Bayesian Optimization for Distributed Stream Data Processing Systems

$π$-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation

HAOTuner: A Hardware Adaptive Operator Auto-Tuner for Dynamic Shape Tensor Compilers

Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scale

An Optimization Toolchain Design Of Deep Learning Deployment Based On Heterogeneous Computing Platform

CoTuning: A Large-Small Model Collaborating Distillation Framework for Better Model Generalization

Improving Resource Usages of Containers Through Auto-Tuning Container Resource Parameters

SoC-Tuner: An Importance-guided Exploration Framework for DNN-targeting SoC Design

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Cooperative Tuning of Multi-Agent Optimal Control Systems

Cstuner: Scalable Auto-tuning Framework for Complex Stencil Computation on GPUs

Res-Tuning: A Flexible and Efficient Tuning Paradigm via Unbinding Tuner from Backbone

ETune: Efficient Configuration Tuning for Big-Data Software Systems Via Configuration Space Reduction

A Fast Parameter Tuning Framework Via Transfer Learning and Multi-Objective Bayesian Optimization

HyperTuner: A Cross-Layer Multi-Objective Hyperparameter Auto-Tuning Framework for Data Analytic Services

Online Thread Auto-Tuning for Performance Improvement and Resource Saving

Co-Tuning for Transfer Learning.