A Study on Metamodeling Techniques, Ensembles, and Multi-Surrogates in Surrogate-Assisted Memetic Algorithms

Dudy Lim,Yew-Soon Ong,Yaochu Jin,Bernhard Sendhoff
2007-01-01
Abstract:Surrogate-Assisted Memetic Algorithm(SAMA) is a hybrid evolutionary algorithm, particularly a memetic algorithm that employs surrogate models in the optimization search. Since most of the objective function evaluations in SAMA are approximated, the search performance of SAMA is likely to be afiected by the characteristics of the models used. In this paper, we study the search performance of using difierent metamodeling techniques, ensembles, and multi- surrogates in SAMA. In particular, we consider the SAMA- TRF, a SAMA model management framework that incorpo- rates a trust region scheme for interleaving use of exact ob- jective function with computationally cheap local metamod- els during local searches. Four difierent metamodels, namely Gaussian Process (GP), Radial Basis Function (RBF), Poly- nomial Regression (PR), and Extreme Learning Machine (ELM) neural network are used in the study. Empirical results obtained show that while some metamodeling tech- niques perform best on particular benchmark problems, en- semble of metamodels and multi-surrogates yield robust and improved solution quality on the benchmark problems in general, for the same computational budget.
What problem does this paper attempt to address?