Abstract:In the pursuit of efficient optimization of expensive-to-evaluate systems, this paper investigates a novel approach to Bayesian multi-objective and multi-fidelity (MOMF) optimization. Traditional optimization methods, while effective, often encounter prohibitively high costs in multi-dimensional optimizations of one or more objectives. Multi-fidelity approaches offer potential remedies by utilizing multiple, less costly information sources, such as low-resolution simulations. However, integrating these two strategies presents a significant challenge. We suggest the innovative use of a trust metric to support simultaneous optimization of multiple objectives and data sources. Our method modifies a multi-objective optimization policy to incorporate the trust gain per evaluation cost as one objective in a Pareto optimization problem, enabling simultaneous MOMF at lower costs. We present and compare two MOMF optimization methods: a holistic approach selecting both the input parameters and the trust parameter jointly, and a sequential approach for benchmarking. Through benchmarks on synthetic test functions, our approach is shown to yield significant cost reductions - up to an order of magnitude compared to pure multi-objective optimization. Furthermore, we find that joint optimization of the trust and objective domains outperforms addressing them in sequential manner. We validate our results using the use case of optimizing laser-plasma acceleration simulations, demonstrating our method's potential in Pareto optimization of high-cost black-box functions. Implementing these methods in existing Bayesian frameworks is simple, and they can be readily extended to batch optimization. With their capability to handle various continuous or discrete fidelity dimensions, our techniques offer broad applicability in solving simulation problems in fields such as plasma physics and fluid dynamics.

A Bi-Fidelity Bayesian Optimization Method for Multi-Objective Optimization with a Novel Acquisition Function

A multi-fidelity Bayesian optimization approach for constrained multi-objective optimization problems

Multi-Fidelity Cost-Aware Bayesian Optimization

Multi-fidelity Bayesian Optimization in Engineering Design

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multi-Modal Functions

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multimodal Functions

sBF-BO-2CoGP: A Sequential Bi-Fidelity Constrained Bayesian Optimization for Design Applications

Dynamic Multi-objective Ensemble of Acquisition Functions in Batch Bayesian Optimization

Bi-objective Bayesian optimization of engineering problems with cheap and expensive cost functions

Process Quality Control Through Bayesian Optimization with Adaptive Local Convergence

Bayesian Optimization For Multi-Objective Mixed-Variable Problems

Cost-Sensitive Multi-Fidelity Bayesian Optimization with Transfer of Learning Curve Extrapolation

Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraints

NM2-BO: Non-Myopic Multifidelity Bayesian Optimization

A Bi-Objective Optimization Based Acquisition Strategy for Batch Bayesian Global Optimization

BOtied: Multi-objective Bayesian optimization with tied multivariate ranks

Multi-Step Budgeted Bayesian Optimization with Unknown Evaluation Costs

On a New Improvement-Based Acquisition Function for Bayesian Optimization

An Efficient and Multi-Fidelity Reliability-Based Design Optimization Method Based on a Novel Surrogate Model Local Update Strategy

Non-Myopic Multi-Objective Bayesian Optimization

Leveraging Trust for Joint Multi-Objective and Multi-Fidelity Optimization