Abstract:Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (population size). If the population size is too small, the update of the probabilistic model builds on few samples, leading to the undesired effect of genetic drift. Too large population sizes avoid genetic drift, but slow down the process. Building on a recent quantitative analysis of how the population size leads to genetic drift, we design a smart-restart mechanism for EDAs. By stopping runs when the risk for genetic drift is high, it automatically runs the EDA in good parameter regimes. Via a mathematical runtime analysis, we prove a general performance guarantee for this smart-restart scheme. This in particular shows that in many situations where the optimal (problem-specific) parameter values are known, the restart scheme automatically finds these, leading to the asymptotically optimal performance. We also conduct an extensive experimental analysis. On four classic benchmark problems, we clearly observe the critical influence of the population size on the performance, and we find that the smart-restart scheme leads to a performance close to the one obtainable with optimal parameter values. Our results also show that previous theory-based suggestions for the optimal population size can be far from the optimal ones, leading to a performance clearly inferior to the one obtained via the smart-restart scheme. We also conduct experiments with PBIL (cross-entropy algorithm) on two combinatorial optimization problems from the literature, the max-cut problem and the bipartition problem. Again, we observe that the smart-restart mechanism finds much better values for the population size than those suggested in the literature, leading to a much better performance.

Average Drift Analysis and Its Application.

A Study of Drift Analysis for Estimating Computation Time of Evolutionary Algorithms

Drift Analysis in Studying the Convergence and Hitting Times of Evolutionary Algorithms: an Overview

Average Drift Analysis and Population Scalability

Drift Analysis and Average Time Complexity of Evolutionary Algorithms

Data-Driven Stochastic Averaging

A Rigorous Proof of a Fundamental Theorem in the Drift Analysis of Evolutionary Algorithms

Intuitive Analyses via Drift Theory

Switch Analysis for Running Time Analysis of Evolutionary Algorithms

Concentration Tail-Bound Analysis of Coevolutionary and Bandit Learning Algorithms

Drift Analysis with Fitness Levels for Elitist Evolutionary Algorithms

Drift Analysis of Mutation Operations for Biogeography-Based Optimization

Improvement and Proof of Fundamental Theorem in Drift Analysis of Evolutionary Algorithms

Lower Bounds for Non-Elitist Evolutionary Algorithms via Negative Multiplicative Drift

From Understanding Genetic Drift to a Smart-Restart Parameter-Less Compact Genetic Algorithm

Runtime analysis for continuous (1+1) evolutionary algorithm based on average gain model

From Understanding Genetic Drift to a Smart-Restart Mechanism for Estimation-of-Distribution Algorithms

Improved Differential Evolution Algorithm and Application

Towards A Theoretical Framework for Analysis and Intervention of Random Drift on General Networks

Towards a More Practice-Aware Runtime Analysis of Evolutionary Algorithms

A new approach for analyzing average time complexity of population-based evolutionary algorithms on unimodal problems.