Abstract:Surrogate models are often used as alternatives to considerably reduce the computational burden of the expensive computer simulations that are required for engineering designs. The development of surrogate models for complex relationships between the parameters often requires the modeling of high-dimensional functions with limited information, and it is challenging to choose an effective surrogate model over the unknown design space. To this end, the ensemble modelscombined with different surrogate modelsoffer effective solutions. This paper presents a new ensemble model based on the least squares method, which is a regularization strategy and an augmentation strategy; we call the model the regularized least squares ensemble model (RLS-EM). Three individual surrogate modelsKriging, radial basis function, and support vector regressionare used to compose the RLS-EM. Further, the weight factors are estimated by the least squares method without using the global or local error metrics, which are used in most existing methods. To solve the collinearity in the least squares calculation process, a regularization strategy and an augmentation strategy are developed. The two strategies help explore the unknown regions and improve the accuracy on one hand; on the other hand, the collinearity can be reduced, and the overfitting phenomenon that may occur can be avoided. Six numerical functions, from two-dimensional to 12-dimensional, and a computer numerical control (CNC) milling machine bed design problem are used to verify the proposed method. The results of the numerical examples show that RLS-EM saves a considerable amount of computation time while ensuring the same level of robustness and accuracy compared with other ensemble models. The RLS-EM used for the CNC milling machine bed design problem also shows good accuracy characteristics compared with other ensemble methods.

A Novel Method for Ensemble of Surrogates Based on Global and Local Measures

Ensemble of Surrogates with Hybrid Method Using Global and Local Measures for Engineering Design

Global Optimization Method Using Adaptive and Parallel Ensemble of Surrogates for Engineering Design Optimization

Ensemble of surrogate based global optimization methods using hierarchical design space reduction

Ensemble of Surrogate Models Using Sign Based Cross Validation Error

The Ensemble of Surrogate Model Based on Local and Global Errors

Ensemble of surrogates in black-box-type engineering optimization: Recent advances and applications

Selecting the Best Quantity and Variety of Surrogates for an Ensemble Model

A Novel Multi-fidelity Surrogate Model with Two-Stage Ensemble

MID-ESM: An Adaptive Median-Based Ensemble of Surrogate Models

A New Sequential Sampling Method for Surrogate Modeling Based on a Hybrid Metric

A surrogate-ensemble assisted expensive many-objective optimization

A Region-Segmentation Combining Surrogate Model Based on L-indicator and N-fold Cross-Validation Technique

Surrogate-assisted global sensitivity analysis: an overview

A Novel Hybrid Sequential Design Strategy for Global Surrogate Modeling of Computer Experiments

Application of a Dirichlet Distribution-Based Ensemble Surrogate Model in Aerodynamic Optimization

A Least Squares Ensemble Model Based on Regularization and Augmentation Strategy

Multiobjective global surrogate modeling, dealing with the 5-percent problem

On the Ensemble of Surrogate Models by Minimum Screening Index

An Evolution Strategy Assisted by an Ensemble of Local Gaussian Process Models.

An Improved Surrogate Based Optimization Method for Expensive Black-box Problems