Abstract:In spite of the wide improvements in computer simulation packages, many complex simulation models, particularly under uncertainty, may be inefficient to run in terms of time, computation, and resources. To address such a challenge, integrating metamodels and robust design optimization has been applied. In the current paper, a systematic comparative study is implemented to evaluate the performance of three common metamodels, namely polynomial regression, kriging, and radial basis function. The required experiments are designed by different space-filling methods including the orthogonal array design and three forms of Latin hypercube sampling such as randomized, maximin, and correlation approaches. Although, the impact of sample size on the performance of metamodels in robust optimization results are investigated. All methods are analyzed using five two-dimensional test problems and one engineering problem while all of them are considered in two forms that are expensive (with a small sample size) and semi-expensive (with a large sample size). Uncertainty is assumed in all problems as a source of variability, so all test problems are conducted in the format of robust optimization in the class of dual response surface in order to estimate robust Pareto frontier. The performances of methods are studied in two terms of accuracy and robustness. Finally, the results of comparison, an applicable guideline is provided to aid the practitioners in selecting the appropriate combination of metamodels and sampling design methods for investigating set of robust optimal points (estimated Pareto frontier) in simulation–optimization problems under uncertainty.

Selecting an Optimal Subset with Regression Metamodels

Efficient Simulation Budget Allocation for Subset Selection Using Regression Metamodels

Metamodel selection based on stepwise regression

Optimal Computing Budget Allocation for Regression with Gradient Information.

Simulation-Based Robust Design of Complex Product Considering Uncertainties of Metamodel, Design Variables, and Noise Parameters

Subset selection for multiple linear regression via optimization

An Optimal Opportunity Cost Selection Procedure for A Fixed Number of Designs

Approximately Optimal Computing Budget Allocation for Selection of the Best and Worst Designs.

A Discrete Choice Model for Subset Selection

A reinforced learning approach to optimal design under model uncertainty

Selecting the Best Simulated Design with the Expected Opportunity Cost Bound.

Efficient Learning for Selecting Top-m Context-Dependent Designs

A mathematical programming approach for integrated multiple linear regression subset selection and validation

Selection of Initial Designs for Multi-Objective Optimization Using Classification and Regression Tree

CVXSADes: a stochastic algorithm for constructing optimal exact regression designs with single or multiple objectives

Multi-Model Subset Selection

Optimal subgroup selection

Regression and Kriging metamodels with their experimental designs in simulation: A review

An efficient optimization approach for best subset selection in linear regression, with application to model selection and fitting in autoregressive time-series

Optimal discriminating designs for several competing regression models

Comparative study of metamodeling and sampling design for expensive and semi-expensive simulation models under uncertainty