Abstract:Theory of evolutionary computation (EC) aims at providing mathematically founded statements about the performance of evolutionary algorithms (EAs). The predominant topic in this research domain is runtime analysis, which studies the time it takes a given EA to solve a given optimization problem. Runtime analysis has witnessed significant advances in the last couple of years, allowing us to compute precise runtime estimates for several EAs and several problems. Runtime analysis is, however (and unfortunately!), often judged by practitioners to be of little relevance for real applications of EAs. Several reasons for this claim exist. We address two of them in this present work: (1) EA implementations often differ from their vanilla pseudocode description, which, in turn, typically form the basis for runtime analysis. To close the resulting gap between empirically observed and theoretically derived performance estimates, we therefore suggest to take this discrepancy into account in the mathematical analysis and to adjust, for example, the cost assigned to the evaluation of search points that equal one of their direct parents (provided that this is easy to verify as is the case in almost all standard EAs). (2) Most runtime analysis results make statements about the expected time to reach an optimal solution (and possibly the distribution of this optimization time) only, thus explicitly or implicitly neglecting the importance of understanding how the function values evolve over time. We suggest to extend runtime statements to runtime profiles, covering the expected time needed to reach points of intermediate fitness values. As a direct consequence, we obtain a result showing that the greedy (2+1) GA of Sudholt [GECCO 2012] outperforms any unary unbiased black-box algorithm on OneMax.

Statistical Racing Techniques for Improved Empirical Evaluation of Evolutionary Algorithms.

A Method for Assessing the Performance of Genetic Algorithm Optimization for Water Distribution Design

An improved small-sample statistical test for comparing the success rates of evolutionary algorithms

Combining Meta-Eas and Racing for Difficult Ea Parameter Tuning Tasks

A Hybrid Approach To Parameter Tuning In Genetic Algorithms

Towards a More Practice-Aware Runtime Analysis of Evolutionary Algorithms

KW-Race and Fast KW-Race: Racing-Based Frameworks for Tuning Parameters of Evolutionary Algorithms on Black-Box Optimization Problems.

Automated Configuration of Genetic Algorithms by Tuning for Anytime Performance

Non-Elitist Selection Can Improve the Performance of Irace

Use of statistical outlier detection method in adaptive evolutionary algorithms

A Surrogate-Assisted Evolutionary Algorithm with Random Feature Selection for Large-Scale Expensive Problems

Using Experimental Design Methods To Design Efficient Evolutionary Algorithms

On the Effectiveness of Simple Success-Based Parameter Selection Mechanisms for Two Classical Discrete Black-Box Optimization Benchmark Problems

Speeding-up Evolutionary Algorithms to solve Black-Box Optimization Problems

Efficiency and Effectiveness Metrics in Evolutionary Algorithms and Their Application

A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization

Improving evolutionary algorithms with information feedback model for large-scale many-objective optimization

An empirical comparison of three novel genetic algorithms

Efficient Search for Robust Solutions by Means of Evolutionary Algorithms and Fitness Approximation

Simple on-the-fly parameter selection mechanisms for two classical discrete black-box optimization benchmark problems

Global Versus Local Search: the Impact of Population Sizes on Evolutionary Algorithm Performance