Abstract:Surrogate models are often used as alternatives to considerably reduce the computational burden of the expensive computer simulations that are required for engineering designs. The development of surrogate models for complex relationships between the parameters often requires the modeling of high-dimensional functions with limited information, and it is challenging to choose an effective surrogate model over the unknown design space. To this end, the ensemble modelscombined with different surrogate modelsoffer effective solutions. This paper presents a new ensemble model based on the least squares method, which is a regularization strategy and an augmentation strategy; we call the model the regularized least squares ensemble model (RLS-EM). Three individual surrogate modelsKriging, radial basis function, and support vector regressionare used to compose the RLS-EM. Further, the weight factors are estimated by the least squares method without using the global or local error metrics, which are used in most existing methods. To solve the collinearity in the least squares calculation process, a regularization strategy and an augmentation strategy are developed. The two strategies help explore the unknown regions and improve the accuracy on one hand; on the other hand, the collinearity can be reduced, and the overfitting phenomenon that may occur can be avoided. Six numerical functions, from two-dimensional to 12-dimensional, and a computer numerical control (CNC) milling machine bed design problem are used to verify the proposed method. The results of the numerical examples show that RLS-EM saves a considerable amount of computation time while ensuring the same level of robustness and accuracy compared with other ensemble models. The RLS-EM used for the CNC milling machine bed design problem also shows good accuracy characteristics compared with other ensemble methods.

An Established Scheme of Surrogate Model Based on Radial Basis Function

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

A Rbf Network Modeling Approach Combining Ga and Orthogonal Optimum Seeking Method

DNA-NSGA-Ⅱ Nonlinear Dynamic System Modeling Approach Using RBF Neural Networks

RBF design method based on center clustering and PSO

A Cooperative Radial Basis Function Method for Variable-Fidelity Surrogate Modeling

Research on Surrogate Model Based on Local Radial Point Interpolation Method

A surrogate-based optimization method with RBF neural network enhanced by linear interpolation and hybrid infill strategy

Study on shape parameter selection for surrogate model constructed by using radial basis function

An Efficient Ensemble of Radial Basis Functions Method Based on Quadratic Programming

Inverse Distance Weighting and Radial Basis Function Based Surrogate Model for High-Dimensional Expensive Multi-Objective Optimization

A Fast Global Optimal Technique Based On Combinations Of Improved Radial Basis Functions And Tabu Search Method

Scaling Up Radial Basis Function for High-Dimensional Expensive Optimization Using Random Projection

An aRBF surrogate-assisted neighborhood field optimizer for expensive problems

A Novel Rbf Tuning Strategy for Global Surrogate Modeling

A sequential surrogate method for reliability analysis based on radial basis function

A Novel Two Stage Algorithm for Construction of RBF Neural Models Based on A-optimality Criterion

Analytical robust design optimization based on a hybrid surrogate model by combining polynomial chaos expansion and Gaussian kernel

General-Surrogate Adaptive Sampling Using Interquartile Range for Design Space Exploration

A new approach for data-driven surrogate modelling applied in highly nonlinear engineering functions

A Least Squares Ensemble Model Based on Regularization and Augmentation Strategy