Abstract:Adaptive sampling methods have been used to build accurate meta-models across large design spaces from which engineers can explore data trends, investigate optimal designs, study the sensitivity of objectives on the modeling design features, etc. For global design optimization applications, adaptive sampling methods need to be extended to sample more efficiently near the optimal domains of the design space (i.e., the Pareto front/frontier in multi-objective optimization). Expected Improvement (EI) methods have been shown to be efficient to solve design optimization problems using meta-models by incorporating prediction uncertainty.In this paper, a set of state-of-the-art methods (hypervolume EI method and centroid EI method) are presented and implemented for selecting sampling points for multi-objective optimizations. The classical hypervolume EI method uses hyper rectangles to represent the Pareto front, which shows undesirable behavior at the tails of the Pareto front. This issue is addressed utilizing the concepts from physical programming to shape the Pareto front. The modified hypervolume EI method can be extended to increase local Pareto front accuracy in any area identified by an engineer, and this method can be applied to Pareto frontiers of any shape. A novel hypervolume EI method is also developed that does not rely on the assumption of hyperrectangles, but instead assumes the Pareto frontier can be represented by a convex hull. The method exploits fast methods for convex hull construction and numerical integration, and results in a Pareto front shape that is desired in many practical applications.Various performance metrics are defined in order to quanti-tatively compare and discuss all methods applied to a particular 2D optimization problem from the literature. The modified hypervolume EI methods lead to dramatic resource savings while improving the predictive capabilities near the optimal objective values.

An Expensive Many-Objective Optimization Algorithm Based on Efficient Expected Hypervolume Improvement

Pointwise expected hypervolume improvement for expensive multi-objective optimization

Expensive many-objective evolutionary optimization guided by two individual infill criteria

Surrogate-Assisted Environmental Selection for Fast Hypervolume-based Many-Objective Optimization

A modified hypervolume based expected improvement for multi-objective efficient global optimization method

A two-stage infill strategy and surrogate-ensemble assisted expensive many-objective optimization

Expected-Improvement-Based Methods For Adaptive Sampling In Multi-Objective Optimization Problems

Neighborhood samples and surrogate assisted multi-objective evolutionary algorithm for expensive many-objective optimization problems

Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization

Adaptive nested Monte Carlo approach for multi-objective efficient global optimization

A surrogate-ensemble assisted expensive many-objective optimization

A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization

Variable-fidelity Hypervolume-Based Expected Improvement Criteria for Multi-Objective Efficient Global Optimization of Expensive Functions

A Kriging-Assisted Two-Archive Evolutionary Algorithm for Expensive Many-Objective Optimization.

A composite surrogate-assisted evolutionary algorithm for expensive many-objective optimization

Faster Computation of Expected Hypervolume Improvement

A Hierarchical and Ensemble Surrogate-Assisted Evolutionary Algorithm With Model Reduction for Expensive Many-Objective Optimization

A Performance Indicator-Based Infill Criterion for Expensive Multi-/Many-Objective Optimization

Efficient hierarchical surrogate-assisted differential evolution for high-dimensional expensive optimization

An infill sampling criterion based on improvement of probability and mapping crowding distance for expensive multi/many-objective optimization

A surrogate-assisted evolutionary algorithm for expensive many-objective optimization in the refining process