Abstract:Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (population size). If the population size is too small, the update of the probabilistic model builds on few samples, leading to the undesired effect of genetic drift. Too large population sizes avoid genetic drift, but slow down the process. Building on a recent quantitative analysis of how the population size leads to genetic drift, we design a smart-restart mechanism for EDAs. By stopping runs when the risk for genetic drift is high, it automatically runs the EDA in good parameter regimes. Via a mathematical runtime analysis, we prove a general performance guarantee for this smart-restart scheme. This in particular shows that in many situations where the optimal (problem-specific) parameter values are known, the restart scheme automatically finds these, leading to the asymptotically optimal performance. We also conduct an extensive experimental analysis. On four classic benchmark problems, we clearly observe the critical influence of the population size on the performance, and we find that the smart-restart scheme leads to a performance close to the one obtainable with optimal parameter values. Our results also show that previous theory-based suggestions for the optimal population size can be far from the optimal ones, leading to a performance clearly inferior to the one obtained via the smart-restart scheme. We also conduct experiments with PBIL (cross-entropy algorithm) on two combinatorial optimization problems from the literature, the max-cut problem and the bipartition problem. Again, we observe that the smart-restart mechanism finds much better values for the population size than those suggested in the literature, leading to a much better performance.

An improved small-sample statistical test for comparing the success rates of evolutionary algorithms

Convergence Analysis of General Evolutionary Algorithms

A Method for Assessing the Performance of Genetic Algorithm Optimization for Water Distribution Design

Statistical Racing Techniques for Improved Empirical Evaluation of Evolutionary Algorithms.

EBT: a Statistic Test Identifying Moderate Size of Significant Features with Balanced Power and Precision for Genome-Wide Rate Comparisons

Optimizing Genetic Algorithms Using the Binomial Distribution

Use of statistical outlier detection method in adaptive evolutionary algorithms

Improved Differential Evolution Algorithm and Application

On the Effectiveness of Simple Success-Based Parameter Selection Mechanisms for Two Classical Discrete Black-Box Optimization Benchmark Problems

Adaptation of the Scaling Factor Based on the Success Rate in Differential Evolution

Analysis of Noisy Evolutionary Optimization When Sampling Fails

A Dynamic Optimization Strategy for Evolutionary Testing

Systematic Testing of Genetic Algorithms: A Metamorphic Testing based Approach

Analysing the fitness landscape of search-based software testing problems

Sample size calculations for the experimental comparison of multiple algorithms on multiple problem instances

Configuration Strategies for Evolutionary Testing.

Evolutionary Algorithms for Limiting the Effect of Uncertainty for the Knapsack Problem with Stochastic Profits

Efficiently estimating small p-values in permutation tests using importance sampling and cross-entropy method

From Understanding Genetic Drift to a Smart-Restart Mechanism for Estimation-of-Distribution Algorithms

Some Improvements on Adaptive Genetic Algorithms for Reliability-Related Applications

Comparing Evolutionary Rates Using An Exact Test for 2x2 Tables with Continuous Cell Entries