Markov Chain Analysis of Evolutionary Algorithms on OneMax Function - from Coupon Collector's Problem to (1+1) EA

Yu-an Zhang,Xiaofeng Qin,Qinglian Ma,Minghao Zhao,Satoru Hiwa,Tomoyuki Hiroyasu,Hiroshi Furutani
DOI: https://doi.org/10.1016/j.tcs.2020.03.007
IF: 1.002
2020-01-01
Theoretical Computer Science
Abstract:The theoretical investigation of Evolutionary Algorithms (EAs) has increased our understanding of the computational mechanism of algorithms. OneMax is a test function most frequently and deeply studied in the field of EAs. In this work, a method is presented for describing the runtime properties of (1+1) EA on OneMax. This method is motivated by the work of Erdös and Rényi treating the coupon collector's problem. They showed that the success probability of the coupon collector's problem is given by a function of double exponential form, and that the number of uncollected coupons follows the Poisson distribution. Today, the double exponential function is called Gumbel function, which is one of three fundamental functions in extreme value statistics. We introduce an algorithm that is a variant of the (1+1) EA, First Order Evolutionary Algorithm (FO-EA). FO-EA takes into account only the effect of single-bit mutations in the (1+1) EA, which in general includes multiple-bit mutations. We modified the method of Erdös and Rényi to apply FO-EA. We apply the Gumbel distribution for calculating the success probability of the (1+1) EA on OneMax. This method turns out to give a sufficiently reliable estimation for success probabilities, even in the tail region.
What problem does this paper attempt to address?