Abstract:Optimizing objectives under constraints, where both the objectives and constraints are black box functions, is a common scenario in real-world applications such as scientific experimental design, design of medical therapies, and industrial process optimization. One popular approach to handling these complex scenarios is Bayesian Optimization (BO). In terms of theoretical behavior, BO is relatively well understood in the unconstrained setting, where its principles have been well explored and validated. However, when it comes to constrained Bayesian optimization (CBO), the existing framework often relies on heuristics or approximations without the same level of theoretical guarantees. In this paper, we delve into the theoretical and practical aspects of constrained Bayesian optimization, where the objective and constraints can be independently evaluated and are subject to noise. By recognizing that both the objective and constraints can help identify high-confidence regions of interest (ROI), we propose an efficient CBO framework that intersects the ROIs identified from each aspect to determine the general ROI. The ROI, coupled with a novel acquisition function that adaptively balances the optimization of the objective and the identification of feasible regions, enables us to derive rigorous theoretical justifications for its performance. We showcase the efficiency and robustness of our proposed CBO framework through empirical evidence and discuss the fundamental challenge of deriving practical regret bounds for CBO algorithms.

Constraining the Feasible Design Space in Bayesian Optimization With User Feedback

Cooperative Multi-Objective Bayesian Design Optimization

Bayesian optimization of variable-size design space problems

Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties

Expert-guided Bayesian Optimisation for Human-in-the-loop Experimental Design of Known Systems

Bayesian optimization as a flexible and efficient design framework for sustainable process systems

Human-algorithm collaborative Bayesian optimization for engineering systems

Constraint Handling in Bayesian Optimization -- A Comparative Study of Support Vector Machine, Augmented Lagrangian and Expected Feasible Improvement

Bayesian Optimisation for Constrained Problems

Multi-fidelity Bayesian Optimization in Engineering Design

Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraints

Multi-information source constrained Bayesian optimization

A robust multi-objective Bayesian optimization framework considering input uncertainty

Bayesian optimization with adaptive surrogate models for automated experimental design

An Induced Natural Selection Heuristic for Finding Optimal Bayesian Experimental Designs

Bayesian multi-objective optimization of process design parameters in constrained settings with noise: an engineering design application

Practical Path-based Bayesian Optimization

Asynchronous Multi-Information Source Bayesian Optimization

Graph-Based Bayesian Optimization for Large-Scale Objective-Based Experimental Design

Design optimization in unilateral contact using pressure constraints and Bayesian optimization