Abstract:Abstract In the field of expensive optimization, numerous papers have proposed surrogate-assisted evolutionary algorithms (SAEAs) for a few thousand or even hundreds of function evaluations. However, in reality, low-cost simulations suffice for a lot of real-world problems, in which the number of function evaluations is moderately restricted, e.g., to several thousands. In such moderately restricted scenario, SAEAs become unnecessarily time-consuming and tend to struggle with premature convergence. In addition, tuning the SAEA parameters becomes impractical under the restricted budgets of function evaluations—in some cases, inadequate configuration may degrade performance instead. In this context, this paper presents a fast and auto-tunable evolutionary algorithm for solving moderately restricted expensive optimization problems. The presented algorithm is a variant of adaptive differential evolution (DE) algorithms, and is called emulation-based adaptive DE or EBADE. The primary aim of EBADE is to emulate the principle of sample-efficient optimization, such as that in SAEAs, by adaptively tuning the DE parameter configurations. Specifically, similar to Expected Improvement-based sampling, EBADE identifies parameter configurations that may produce expected-to-improve solutions, without using function evaluations. Further, EBADE incepts a multi-population mechanism and assigns a parameter configuration to each subpopulation to estimate the effectiveness of parameter configurations with multiple samples carefully. This subpopulation-based adaptation can help improve the selection accuracy of promising parameter configurations, even when using an expected-to-improve indicator with high uncertainty, by validating with respect to multiple samples. The experimental results demonstrate that EBADE outperforms modern adaptive DEs and is highly competitive compared to SAEAs with a much shorter runtime.

A Surrogate-Assisted Differential Evolution with fitness-independent parameter adaptation for high-dimensional expensive optimization

Emulation-based adaptive differential evolution: fast and auto-tunable approach for moderately expensive optimization problems

A two-stage dominance-based surrogate-assisted evolution algorithm for high-dimensional expensive multi-objective optimization

A dual surrogate assisted evolutionary algorithm based on parallel search for expensive multi/many-objective optimization

Efficient hierarchical surrogate-assisted differential evolution for high-dimensional expensive optimization

Two-Stage Data-Driven Evolutionary Optimization for High-Dimensional Expensive Problems

Multiple surrogates and offspring-assisted differential evolution for high-dimensional expensive problems

A review of surrogate-assisted evolutionary algorithms for expensive optimization problems

Surrogate-assisted Autoencoder-embedded Evolutionary Optimization Algorithm to Solve High-dimensional Expensive Problems

An Ensemble Surrogate-based Framework for Expensive Multiobjective Evolutionary Optimization

Cooperative coevolutionary surrogate ensemble-assisted differential evolution with efficient dual differential grouping for large-scale expensive optimization problems

Combining Lipschitz and RBF Surrogate Models for High-dimensional Computationally Expensive Problems

Incorporating Gradient Information into Dimension Perturbation Mutation for High-dimensional Expensive Optimization

Complementary surrogate-assisted differential evolution algorithm for expensive multi-objective problems under a limited computational budget

A Surrogate Model Assisted Evolutionary Algorithm for Computationally Expensive Design Optimization Problems with Discrete Variables.

Computationally Expensive High-Dimensional Multiobjective Optimization via Surrogate-Assisted Reformulation and Decomposition

Surrogate ensemble assisted large-scale expensive optimization with random grouping

A Surrogate-Assisted Evolutionary Algorithm for Expensive Dynamic Multimodal Optimzation

A Supervised Surrogate-Assisted Evolutionary Algorithm for Complex Optimization Problems

A Hierarchical and Ensemble Surrogate-Assisted Evolutionary Algorithm With Model Reduction for Expensive Many-Objective Optimization

Surrogate Assisted Evolutionary Algorithm for Medium Scale Expensive Multi-Objective Optimisation Problems