Abstract:Despite the state-of-the-art performance of the covariance matrix adaptation evolution strategy (CMA-ES), high-dimensional black-box optimization problems are challenging tasks. Such problems often involve a property called low effective dimensionality (LED), in which the objective function is formulated with redundant dimensions relative to the intrinsic objective function and a rotation transformation of the search space. The CMA-ES suffers from LED for two reasons: the default hyperparameter setting is determined by the total number of dimensions, and the norm calculations in step-size adaptations are performed including elements on the redundant dimensions. In this paper, we incorporate countermeasures for LED into the CMA-ES and propose CMA-ES-LED. We tackle with the rotation transformation using the eigenvectors of the covariance matrix. We estimate the effectiveness of each dimension in the rotated search space using the element-wise signal-to-noise ratios of the mean vector update and the rank-$\mu$ update, both of which updates can be explained as the natural gradient ascent. Then, we adapt the hyperparameter using the estimated number of effective dimensions. In addition, we refine the cumulative step-size adaptation and the two-point step-size adaptation to measure the norms only on the effective dimensions. The experimental results show the CMA-ES-LED outperforms the CMA-ES on benchmark functions with LED.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to solve the Low Effective Dimensionality (LED) challenge in high - dimensional black - box optimization problems. Specifically, when the value of the objective function is determined only by certain elements in the rotated search space and is not affected by other redundant dimensions, this characteristic will lead to the performance degradation of the traditional Covariance Matrix Adaptation Evolution Strategy (CMA - ES). Therefore, the author proposes an improved CMA - ES algorithm - CMA - ES - LED to deal with these problems. #### The Low Effective Dimensionality (LED) problem Low effective dimensionality means that in high - dimensional optimization problems, the actual dependence of the objective function is concentrated on only a few dimensions, while the remaining dimensions have almost no impact on the objective function. For example, this situation is often encountered in practical applications such as hyper - parameter optimization in machine learning, control of over - actuated systems, and shape optimization. #### Challenges faced by CMA - ES 1. **Problem of default hyper - parameter settings**: The default hyper - parameters of CMA - ES are determined according to the total number of dimensions, which may lead to performance degradation when dealing with low - effective - dimensionality problems. 2. **Problem of norm calculation in step - size adaptation**: The step - size adaptation rules in CMA - ES (such as Cumulative Step - size Adaptation CSA and Two - Point Step - size Adaptation TPA) will consider redundant dimensions when calculating the norm, which will also affect its performance. #### Solutions To solve the above problems, the author proposes CMA - ES - LED, which is mainly improved through the following methods: 1. **Estimating rotation transformation**: Use the eigenvectors of the covariance matrix to estimate the rotation transformation, thereby reconstructing the landscape of the intrinsic objective function. 2. **Estimating the effectiveness of each dimension**: Calculate the element - level signal - to - noise ratio (SNR) of the mean vector update direction and the covariance matrix update direction, and introduce a monotonically increasing function to convert these SNRs into estimates of the effectiveness of each dimension. 3. **Hyper - parameter adaptation mechanism**: Adjust the hyper - parameters according to the estimated number of effective dimensions instead of using the total number of dimensions. 4. **Improved step - size adaptation rules**: In CSA and TPA, measure the norm only on the effective dimensions to avoid the influence of redundant dimensions. Through these improvements, CMA - ES - LED can show better performance on low - effective - dimensionality problems, and the experimental results on benchmark test functions also verify this. In addition, the performance of CMA - ES - LED on non - low - effective - dimensionality problems is comparable to or even better than that of the original CMA - ES. ### Summary The main contribution of this paper is to propose a new CMA - ES variant - CMA - ES - LED, which is specifically optimized for low - effective - dimensionality problems, thereby improving the search performance in high - dimensional black - box optimization tasks.

Covariance Matrix Adaptation Evolution Strategy for Low Effective Dimensionality

Large-Scale Evolution Strategy Based on Search Direction Adaptation

CMA-ES with Learning Rate Adaptation

CMA-ES with Adaptive Reevaluation for Multiplicative Noise

CMA-ES with Learning Rate Adaptation: Can CMA-ES with Default Population Size Solve Multimodal and Noisy Problems?

Covariance matrix adaptation evolution strategy based on correlated evolution paths with application to reinforcement learning

Covariance Matrix Adaptation for the Rapid Illumination of Behavior Space

The CMA Evolution Strategy: A Tutorial

An Efficient Elitist Covariance Matrix Adaptation For Continuous Local Search In High Dimension

Elite-driven surrogate-assisted CMA-ES algorithm by improved lower confidence bound method

An Adaptive Re-evaluation Method for Evolution Strategy under Additive Noise

An adaptive penalty based covariance matrix adaptation–evolution strategy

Fast Moving Natural Evolution Strategy for High-Dimensional Problems

A Simple Yet Efficient Rank One Update for Covariance Matrix Adaptation.

Distributed Evolution Strategies with Multi-Level Learning for Large-Scale Black-Box Optimization

Covariance Matrix Adaptation MAP-Annealing

Covariance matrix adaptation for multi-objective optimization

A Differential Covariance Matrix Adaptation Evolutionary Algorithm for real parameter optimization

An Efficient Rank-1 Update for Cholesky CMA-ES Using Auxiliary Evolution Path.

Natural Gradient Interpretation of Rank-One Update in CMA-ES

Enhancing the competitive swarm optimizer with covariance matrix adaptation for large scale optimization