Abstract:Estimation-of-distribution algorithms (EDAs) are optimization algorithms that learn a distribution on the search space from which good solutions can be sampled easily. A key parameter of most EDAs is the sample size (population size). If the population size is too small, the update of the probabilistic model builds on few samples, leading to the undesired effect of genetic drift. Too large population sizes avoid genetic drift, but slow down the process. Building on a recent quantitative analysis of how the population size leads to genetic drift, we design a smart-restart mechanism for EDAs. By stopping runs when the risk for genetic drift is high, it automatically runs the EDA in good parameter regimes. Via a mathematical runtime analysis, we prove a general performance guarantee for this smart-restart scheme. This in particular shows that in many situations where the optimal (problem-specific) parameter values are known, the restart scheme automatically finds these, leading to the asymptotically optimal performance. We also conduct an extensive experimental analysis. On four classic benchmark problems, we clearly observe the critical influence of the population size on the performance, and we find that the smart-restart scheme leads to a performance close to the one obtainable with optimal parameter values. Our results also show that previous theory-based suggestions for the optimal population size can be far from the optimal ones, leading to a performance clearly inferior to the one obtained via the smart-restart scheme. We also conduct experiments with PBIL (cross-entropy algorithm) on two combinatorial optimization problems from the literature, the max-cut problem and the bipartition problem. Again, we observe that the smart-restart mechanism finds much better values for the population size than those suggested in the literature, leading to a much better performance.

On the Average Runtime of an Open Source Binomial Random Variate Generation Algorithm

Optimizing Genetic Algorithms Using the Binomial Distribution

Some Approximations to the Binomial Distribution Function

Algorithms for Generating Small Random Samples

An Algorithm for Computing the Distribution Function of the Generalized Poisson-Binomial Distribution

Closed-form solutions for Bernoulli and compound Poisson branching processes in random environments

Implementation of a Parallel Algorithm to Simulate the Type I Error Probability

From Understanding Genetic Drift to a Smart-Restart Mechanism for Estimation-of-Distribution Algorithms

Closed-form solutions for Bernoulli and compound Poisson branching processes in random environments *

Total variation distance and compound poisson approximations for random sums

Efficient pseudo-random number generators for biomolecular simulations on graphics processors

An asymptotically optimal algorithm for generating bin cardinalities

A Comparison of Two Random Number Generators for the Birnbaum–Saunders Distribution

Runtime Analysis of Competitive Co-evolutionary Algorithms for Maximin Optimisation of a Bilinear Function

On the Analysis of Average Time Complexity of Estimation of Distribution Algorithms

The generalized Poisson-binomial distribution and the computation of its distribution function

Parallelizing Computation of Expected Values in Recombinant Binomial Trees

The Number of Triangles in Random Intersection Graphs

Automated Tail Bound Analysis for Probabilistic Recurrence Relations.

Outperforming Good-Turing: Preliminary Report