Abstract:Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize new tasks faster. However, existing meta-learning BO methods rely on surrogate models that suffer from scalability issues and are sensitive to observations with different scales and noise types across tasks. Moreover, they often overlook the uncertainty associated with task similarity. This leads to unreliable task adaptation when only limited observations are obtained or when the new tasks differ significantly from the related tasks. To address these limitations, we propose a novel meta-learning BO approach that bypasses the surrogate model and directly learns the utility of queries across tasks. Our method explicitly models task uncertainty and includes an auxiliary model to enable robust adaptation to new tasks. Extensive experiments show that our method demonstrates strong anytime performance and outperforms state-of-the-art meta-learning BO methods in various benchmarks.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenges faced by Bayesian Optimization (BO) in dealing with the optimization of expensive black - box functions, especially when these functions have different scales and noise types. Traditional methods usually rely on surrogate models (such as Gaussian processes), and these methods have limitations when dealing with large - scale data or scale changes between tasks and differences in noise types. In addition, although existing meta - learning methods can use the knowledge of related tasks to accelerate the optimization of new tasks, they are insufficient in estimating task similarity, especially when the new task is significantly different from the previously seen tasks or has not been fully explored. To overcome these problems, the paper proposes a new meta - learning Bayesian optimization method - MALIBO (Meta - learning for Likelihood - free Bayesian Optimization). The main contributions of MALIBO are as follows: 1. **Directly model the acquisition function**: MALIBO avoids using surrogate models by directly approximating the acquisition function of a given task, which enables it to learn more effectively across tasks while dealing with heterogeneous observation scales and noise types in different tasks. 2. **Probabilistic meta - learning model**: MALIBO introduces a probabilistic meta - learning model to capture task uncertainty and a novel adaptation procedure based on gradient boosting to robustly adapt to each new task. 3. **Enhanced adaptability**: By combining Thompson Sampling and Gradient Boosting as a residual prediction model, MALIBO can encourage exploration in the early stage and gradually rely on the knowledge of the target task as the optimization process progresses, thereby achieving more reliable task adaptation. Overall, MALIBO aims to provide a scalable and robust meta - learning Bayesian optimization method, especially suitable for scenarios where large - scale data sets and complex task distributions need to be processed.

MALIBO: Meta-learning for Likelihood-free Bayesian Optimization

On Provably Robust Meta-Bayesian Optimization

RLBOF: Reinforcement Learning from Bayesian Optimization Feedback

Large Language Models to Enhance Bayesian Optimization

Co-Learning Bayesian Optimization.

Meta Learning Black-Box Population-Based Optimizers

Meta-Learning Priors for Safe Bayesian Optimization

Bayesian Optimization for Developmental Robotics with Meta-Learning by Parameters Bounds Reduction

High-dimensional Bayesian optimization using low-dimensional feature spaces

Optimizing Closed-Loop Performance with Data from Similar Systems: A Bayesian Meta-Learning Approach

Scalable PAC-Bayesian Meta-Learning via the PAC-Optimal Hyper-Posterior: From Theory to Practice

Modulating Surrogates for Bayesian Optimization

Transfer Learning for Bayesian Optimization: A Survey

A Stochastic Approach to Bi-Level Optimization for Hyperparameter Optimization and Meta Learning

A General Recipe for Likelihood-free Bayesian Optimization

Semi-supervised Embedding Learning for High-dimensional Bayesian Optimization

ST-MAML: A Stochastic-Task based Method for Task-Heterogeneous Meta-Learning

Federated Many-Task Bayesian Optimization

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multimodal Functions

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multi-Modal Functions

Offline Model-Based Optimization by Learning to Rank