Abstract:Extending Bayesian optimization to batch evaluation can enable the designer to make the most use of parallel computing technology. Most of current batch approaches use artificial functions to simulate the sequential Bayesian optimization algorithm's behavior to select a batch of points for parallel evaluation. However, as the batch size grows, the accumulated error introduced by these artificial functions increases rapidly, which dramatically decreases the optimization efficiency of the algorithm. In this work, we propose a simple and efficient approach to extend Bayesian optimization to batch evaluation. Different from existing batch approaches, the idea of the new approach is to draw a batch of subspaces of the original problem and select one acquisition point from each subspace. To achieve this, we propose the expected subspace improvement criterion to measure the amount of the improvement that a candidate point can achieve within a certain subspace. By optimizing these expected subspace improvement functions simultaneously, we can get a batch of query points for expensive evaluation. Numerical experiments show that our proposed approach can achieve near-linear speedup when compared with the sequential Bayesian optimization algorithm, and performs very competitively when compared with eight state-of-the-art batch algorithms. This work provides a simple yet efficient approach for batch Bayesian optimization. A Matlab implementation of our approach is available at <a class="link-external link-https" href="https://github.com/zhandawei/Expected_Subspace_Improvement_Batch_Bayesian_Optimization" rel="external noopener nofollow">this https URL</a>

Batch Bayesian Optimization Via Adaptive Local Search.

Bayesian Optimization Based on Pseudo Labels

Process Quality Control Through Bayesian Optimization with Adaptive Local Convergence

Adaptive Local Bayesian Optimization Over Multiple Discrete Variables

Batch Bayesian Optimization via Particle Gradient Flows

Practical Batch Bayesian Optimization for Less Expensive Functions

Dynamic Multi-objective Ensemble of Acquisition Functions in Batch Bayesian Optimization

Simulation Based Bayesian Optimization

Batch Bayesian Optimization via Expected Subspace Improvement

A Batched Scalable Multi-Objective Bayesian Optimization Algorithm.

A Comprehensive Pragmatic Investigation of Batched Acquisition Functions in Bayesian Optimization

On Batch Bayesian Optimization

Batched Energy-Entropy acquisition for Bayesian Optimization

A Bi-Objective Optimization Based Acquisition Strategy for Batch Bayesian Global Optimization

Dynamic Batch Bayesian Optimization

Bayesian Optimization Based on K-Optimality

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multimodal Functions

Bayesian Optimization for Multi-objective Optimization and Multi-point Search

Deep Kernel Learning-Based Bayesian Optimization with Adaptive Kernel Functions

Adaptive Expansion Bayesian Optimization for Unbounded Global Optimization

Bayesian Optimization under Stochastic Delayed Feedback