Abstract:To relieve the computational burden and improve the global optimizing ability of Covariance Matrix Adaptation Evolution Strategy (CMA-ES) for real-world expensive problems, an elite-driven surrogate-assisted CMA-ES (ES-CMA-ES) algorithm by the improved Lower Confidence Bound (ILCB) method is proposed in this paper. Firstly, the ILCB method is established by introducing the step size, which captures the trend of exploration and exploitation in CMA-ES, to control the uncertainty term of the ILCB formula adaptively. Next, based on the ILCB method, a novel model management consisting of the efficient pre-screening strategy and the competitive chaotic operator is developed. In each generation of ES-CMA-ES, a large number of candidate points are sampled first, and then a few of them with better ILCB predicted values are screened out by the efficient pre-screening strategy, aiming to enhance the sampling quality and accelerate the optimization convergence. Moreover, the local search is performed on the best-performing screened sample points utilizing the competitive chaotic operator, with the purpose of increasing the diversity of populations in ES-CMA-ES and avoiding being trapped in the local optima. By means of the above procedures of the model management, the elite sample points are finally obtained which will be evaluated by true fitness function in each generation of ES-CMA-ES. To verify the effectiveness of ES-CMA-ES, five known black-box optimization algorithms are employed to make a comparison. Firstly, seven typical numerical examples of 10-dimensional and 20-dimensional benchmark functions are carried out, respectively. Furthermore, a 20-dimensional engineering example of the aerospace variable-stiffness composite shell under combined loadings is studied. Results indicate the outstanding efficiency, global optimizing ability and applicability of the proposed ES-CMA-ES compared to its counterpart algorithms.

Tuning the hyper-parameters of CMA-ES with tree-structured Parzen estimators

Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performance

Elite-driven surrogate-assisted CMA-ES algorithm by improved lower confidence bound method

BCMA-ES: A Bayesian approach to CMA-ES

Explorative Data Analysis of Time Series based AlgorithmFeatures of CMA-ES Variants

(1+1)-CMA-ES with Margin for Discrete and Mixed-Integer Problems

Hybrid of PSO and CMA-ES for Global Optimization

A Comparative Study of Large-Scale Variants of CMA-ES

Model Complex Control CMA-ES.

CMA-ES with Adaptive Reevaluation for Multiplicative Noise

CMA-ES with Learning Rate Adaptation

CMA-ES with Learning Rate Adaptation: Can CMA-ES with Default Population Size Solve Multimodal and Noisy Problems?

CMA-ES for Discrete and Mixed-Variable Optimization on Sets of Points

CMA-ES for Safe Optimization

Power Mean Estimation in Stochastic Monte-Carlo Tree_Search

Modified CMA-ES Algorithm for Multi-Modal Optimization: Incorporating Niching Strategies and Dynamic Adaptation Mechanism

The ECME Algorithm: A Simple Extension of EM and ECM with Faster Monotone Convergence

The CMA Evolution Strategy: A Tutorial

Sequential vs. Integrated Algorithm Selection and Configuration: A Case Study for the Modular CMA-ES

The K-CMA Algorithm for Solving Multi-modal Function Optimization Problems

Covariance Matrix Adaptation Evolution Strategy for Low Effective Dimensionality