Abstract:Bayesian optimization (BO) methods based on information theory have obtained state-of-the-art results in several tasks. These techniques heavily rely on the Kullback-Leibler (KL) divergence to compute the acquisition function. In this work, we introduce a novel information-based class of acquisition functions for BO called Alpha Entropy Search (AES). AES is based on the {\alpha}-divergence, that generalizes the KL divergence. Iteratively, AES selects the next evaluation point as the one whose associated target value has the highest level of the dependency with respect to the location and associated value of the global maximum of the optimization problem. Dependency is measured in terms of the {\alpha}-divergence, as an alternative to the KL divergence. Intuitively, this favors the evaluation of the objective function at the most informative points about the global maximum. The {\alpha}-divergence has a free parameter {\alpha}, which determines the behavior of the divergence, trading-off evaluating differences between distributions at a single mode, and evaluating differences globally. Therefore, different values of {\alpha} result in different acquisition functions. AES acquisition lacks a closed-form expression. However, we propose an efficient and accurate approximation using a truncated Gaussian distribution. In practice, the value of {\alpha} can be chosen by the practitioner, but here we suggest to use a combination of acquisition functions obtained by simultaneously considering a range of values of {\alpha}. We provide an implementation of AES in BOTorch and we evaluate its performance in both synthetic, benchmark and real-world experiments involving the tuning of the hyper-parameters of a deep neural network. These experiments show that the performance of AES is competitive with respect to other information-based acquisition functions such as JES, MES or PES.

$\{\text{PF}\}^2$ES: Parallel Feasible Pareto Frontier Entropy Search for Multi-Objective Bayesian Optimization

Joint Entropy Search for Maximally-Informed Bayesian Optimization

A Relative Feasibility Degree Based Approach for Constrained Optimization Problems.

Multi-Fidelity Multi-Objective Bayesian Optimization: An Output Space Entropy Search Approach

Multi-information source constrained Bayesian optimization

Alpha Entropy Search for New Information-based Bayesian Optimization

An Entropy Search Portfolio for Bayesian Optimization

Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization

Variational Entropy Search for Adjusting Expected Improvement

Information-Theoretic Safe Bayesian Optimization

Multi-objective Bayesian Optimization Supported by an Expected Pareto Distance Change

Pseudo-Bayesian Optimization

Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization

A Quantum-Inspired Evolutionary Algorithm for Multi-Objective Design

Surrogate-assisted constraint-handling technique for parametric multi-objective optimization

Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Search

Approximating Robust Pareto Fronts by the MEOF-based Multiobjective Evolutionary Algorithm with Two-level Surrogate Models

Two-step Lookahead Bayesian Optimization with Inequality Constraints

Unexpected Improvements to Expected Improvement for Bayesian Optimization

Trusted-Maximizers Entropy Search for Efficient Bayesian Optimization

Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy