Abstract:Adaptive sampling methods have been used to build accurate meta-models across large design spaces from which engineers can explore data trends, investigate optimal designs, study the sensitivity of objectives on the modeling design features, etc. For global design optimization applications, adaptive sampling methods need to be extended to sample more efficiently near the optimal domains of the design space (i.e., the Pareto front/frontier in multi-objective optimization). Expected Improvement (EI) methods have been shown to be efficient to solve design optimization problems using meta-models by incorporating prediction uncertainty.In this paper, a set of state-of-the-art methods (hypervolume EI method and centroid EI method) are presented and implemented for selecting sampling points for multi-objective optimizations. The classical hypervolume EI method uses hyper rectangles to represent the Pareto front, which shows undesirable behavior at the tails of the Pareto front. This issue is addressed utilizing the concepts from physical programming to shape the Pareto front. The modified hypervolume EI method can be extended to increase local Pareto front accuracy in any area identified by an engineer, and this method can be applied to Pareto frontiers of any shape. A novel hypervolume EI method is also developed that does not rely on the assumption of hyperrectangles, but instead assumes the Pareto frontier can be represented by a convex hull. The method exploits fast methods for convex hull construction and numerical integration, and results in a Pareto front shape that is desired in many practical applications.Various performance metrics are defined in order to quanti-tatively compare and discuss all methods applied to a particular 2D optimization problem from the literature. The modified hypervolume EI methods lead to dramatic resource savings while improving the predictive capabilities near the optimal objective values.

Quasi-LHD sequential sampling method for computer experiments

Optimizing Latin hypercube design for sequential sampling of computer experiments

On Sequential Sampling for Global Metamodeling in Engineering Design

A Sequential Sampling Method for Adaptive Metamodeling Using Data with Highly Nonlinear Relation Between Input and Output Parameters

A sequential sampling strategy to improve the global fidelity of metamodels in multi-level system design

A New Sequential Sampling Method for Surrogate Modeling Based on a Hybrid Metric

Metamodel-based design optimization employing a novel sequential sampling strategy

Sampling Design Method of Fast Optimal Latin Hypercube

A Sequential Sampling Approach for Multi-Fidelity Surrogate Modeling-Based Robust Design Optimization

Design for Sequential Follow-Up Experiments in Computer Emulations

A sequential optimal Latin hypercube design method using an efficient recursive permutation evolution algorithm

Sequential Design of Computer Experiments with Quantitative and Qualitative Factors in Applications to HPC Performance Optimization

Research on improving parallel sequence sampling method in ship type optimization

Enhanced Morris for the Extraction of Significant Parameters in High-Dimensional Design Optimization

Sequential search-based Latin hypercube sampling scheme for digital twin uncertainty quantification with application in EHA

Sequential good lattice point sets for computer experiments

Sequential Sampling Framework for Metamodeling Uncertainty Reduction in Multilevel Optimization of Hierarchical Systems

A new sequential sampling method of surrogate models for design and optimization of dynamic systems

Construction of orthogonal-MaxPro Latin hypercube designs

Expected-Improvement-Based Methods For Adaptive Sampling In Multi-Objective Optimization Problems

Nested symmetrical Latin hypercube designs