Abstract:Industrial problems often take the form of expensive laboratory experiments or computationally-heavy simulations. These expensive experiments or simulations provide valuable information about the underlying latent physical process being modeled. One is often faced with the problem of optimizing the quantity of interest (QoI) being represented by the information source. Querying the information source tens of thousands of times, generally required by state-of-the-art optimization algorithms, is practically infeasible. The problem becomes cumbersome when the number of objectives being optimized is greater than one. In such multi-objective optimization (MOO) scenarios, expected improvement (EI)-based methods have demonstrated great efficiency in converging to the optimal solution while taking into consideration a fixed budget. The EI-based methods, used for expensive MOO problems, are broadly called EI-hypervolume (EIHV) methods. The EI-based algorithm called, Bayesian global optimization (BGO), builds cheap probabilistic models of the objectives, using Gaussian process regression(GPR), and selects the next input to query the information source from amongst a finite set of candidate inputs. The EIHV weighs the potential improvement associated with each of the candidate designs. This iterative process continues until one exhausts the budget. The evaluation of the EIHV becomes painfully expensive, scales exponentially, as the number of objectives increases. The finite set of possible inputs, used to evaluate the EIHV and select the next query, ceases to be a computationally feasible option in order for the overall optimization to proceed. In this work, we aim to investigate the performance of an EI-based algorithm, for optimizing the EIHV for MOO problems. At each iteration of the optimization problem, we optimize the EIHV using EI-based BGO, in order to be computationally efficient. We demonstrate the approach on two mathematical MOO problems and one challenging industrial problem with four objectives. We also compare the results in terms of convergence and savings in computational time with the finite-grid based approach.

Faster Computation of Expected Hypervolume Improvement

Pointwise expected hypervolume improvement for expensive multi-objective optimization

A modified hypervolume based expected improvement for multi-objective efficient global optimization method

An Expensive Many-Objective Optimization Algorithm Based on Efficient Expected Hypervolume Improvement

Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization

Variable-fidelity Hypervolume-Based Expected Improvement Criteria for Multi-Objective Efficient Global Optimization of Expensive Functions

Probability Distribution of Hypervolume Improvement in Bi-objective Bayesian Optimization

Expected-Improvement-Based Methods For Adaptive Sampling In Multi-Objective Optimization Problems

Improving the Expected Improvement Algorithm

A new expected-improvement algorithm for continuous minimax optimization

Expected improvement for expensive optimization: a review

A hierarchical expected improvement method for Bayesian optimization

Expected Improvement versus Predicted Value in Surrogate-Based Optimization

Multi-objective optimization via equivariant deep hypervolume approximation

Unexpected Improvements to Expected Improvement for Bayesian Optimization

A Complete Expected Improvement Criterion for Gaussian Process Assisted Highly Constrained Expensive Optimization

Relative Expected Improvement in Kriging Based Optimization

Regret Bounds for Expected Improvement Algorithms in Gaussian Process Bandit Optimization

Variable-fidelity expected improvement method for efficient global optimization of expensive functions

Computationally Efficient Bayesian Optimization for Multi-objective Industrial Applications

Surrogate-Assisted Environmental Selection for Fast Hypervolume-based Many-Objective Optimization