Probability Convergence Theorems of Genetic Algorithms

张文修,徐宗本,聂赞坎,梁怡

DOI: https://doi.org/10.3969/j.issn.1005-3085.2001.04.001

2001-01-01

Abstract:In the paper, the general probability convergence theorems of Genetic algorithms are given, and probability convergence theorems of some special genetic algorithms has proved by general theory which has given in this paper.

What problem does this paper attempt to address?

Convergence Analysis of General Evolutionary Algorithms

PENG Fuming,YAO Min,BAI Shunke

DOI: https://doi.org/10.3724/sp.j.1087.2013.01571

2013-01-01

Abstract:Traditional Evolutionary Algorithm(EA) convergence research focuses on specific algorithm;consequently the conclusion is only suitable for some specific algorithm.In order to study the convergence of all EAs,this paper presented a general EA including EAs of all operator types.A probability space was set up for the purpose of studying the algorithm's convergence,and all terms on the algorithm were strictly defined in mathematical language,and seven theorems related to the algorithm's convergence were completely proved in the probability space.One of the theorems found the sufficient and necessary conditions for the algorithm's convergence in probability.More importantly,these theorems are suitable to all types of EAs.A system composed of these theorems was established,which could be used to guide the EA design and judge the correctness of an EA theoretically.
Convergence Theorem of Genetic Algorithm

WS Wan,C Xiong

DOI: https://doi.org/10.1109/icsmc.1996.565352

1996-01-01

Abstract:We prove a convergence theorem of genetic algorithms with all the three basic operators in the general sense (the solution space is m-dimensional Eucleadian space). It is the first convergence theorem in the strict sense. It has very meaningful guidance for the practical application of GAs
Almost Sure Convergence of Genetic Algorithms: A Martingale Approach

徐宗本,聂赞坎,张文修

DOI: https://doi.org/10.3321/j.issn:0254-4164.2002.08.001

2002-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:The most convergence analysis on genetic algorithms (GAs) is conducted currently in the sense of probabilistic convergence and based on ergodicity analysis on the GA Markovian chain. Such analysis can not infer in general that the GA would be convergent to a global optimum in a finite number of evolution steps, and it validates normally only for the GAs with the elitist record strategy. In the paper, a martingale analysis approach is proposed to study the almost sure convergence of GAs. It is shown that without using the elitist record strategy, a large class of GAs, including the elitist selection GAs, the global annealing GAs, the canonical GAs with time-varying power gauge transformation, can guaranteedly converge to a global optimum in a finite number of steps, provided the involved crossover rate {PC(t)} and mutation rate {PM(t)} satisfy certain delay conditions. The obtained results underlies application of the GAs, and the suggested martingale analysis approach provides a new methodology for convergence analysis of genetic algorithms.
Further Results on Convergence Analysis of Genetic Algorithm s Based on Axiomatation Model

ZONGBEN XU,ZANKAN NIE,Weixiu ZHANG

DOI: https://doi.org/10.3969/j.issn.1005-3085.2001.01.001

2001-01-01

Abstract:An axiomatic model of simulated evolutionary computation was introd uc edrecently by the authors (IEEE Trans. Evolutionary Computation, in press in 20 01),and, based on the axiomatic model, a general global con vergence analysis of geneticalgorithms and evolutionary strategy was conducted . This paper continues such studyby further relaxing the axiomatation of selec tion and evolution operators, andproviding deeper convegence results of genetic al gorithms. Particularly, we presenta set of very general conditions which a ssures the probabilistic and almost-surelyprobabilistic convergence of genetic algori thms. The formulated conditions aredirectly dependent of the involved GA parameters, and therefore, provide some useful
On the Mechanism and Convergence of Genetic Algorithm

Zhi-gang YU,Shen-min SONG,Guang-ren DUAN

DOI: https://doi.org/10.3321/j.issn:1001-0920.2005.09.003

2005-01-01

Abstract:A new approach based on decomposition of solution space according to difference of genotype is presented to analyze quantitatively the evolutionary course of populations of GA. The analysis yields new insight into the properties of the three phases, mutation, crossover, and fitness selection of a genetic algorithm by representing them as acting on the solution space. The probability distribute of populations over solution space can be calculated by this approach. Theoretically, the capability of finding the global optimum is proved, and a necessary and sufficient condition is obtained namely, the conclusion of building block hypothesis is proved. Meanwhile, under crossover or mutation operator applied to static optimization problems, the probability distribution of populations over solution space can be calculated by means of a finite Markov chain model, and the probability of GA converging to the global optimum also can be estimated. Finally, the reasons about GA deceptive problem and premature convergence are discussed.
ON THE CONVERGENCE OF REAL-CODED GENETIC ALGORITHMS

Dan LIN,Min-Qiang LI,Ji-Song KOU

2000-01-01

Journal of Computer Research and Development

Abstract:Genetic algorithms based on real (floating) coded (FGAs) have received a great deal of attention regarding their potential as optimization techniques for complex functions, but the complete convergent results are still rare. In this paper, the convergence of FGAs used in most applications is analyzed and some general conclusions are obtained under best individual preservation strategy. Then by using them the convergence of FGAs is examined when using ordinary mutation and crossover operators. These results not only give useful convergence conclusions but also provide more insights into operators and give help to design adaptation operators. Besides, the process and results still hold true when discussing the convergence of EP(evdutionary programming) and ESs(evdutionary strategies).
A Study of Compulsive Genetic Algorithm and Its Performance

Lei Pan,LiangXian Gu,Yuan Gao

DOI: https://doi.org/10.1109/ICICTA.2008.200

2008-01-01

Abstract:The convergence and local research ability of genetic algorithm is a well concerned research field in recent years. New evolution law of species is introduced in the paper, and based on the new evolution law, compulsive operator was introduced and a new genetic algorithm - compulsive genetic algorithm (CGA) was proposed to improve the convergence of GA. CGA takes advantage of the fitness of current and past generations to create an approximation of the evolution process, identify the evolution direction and improve their evolution progress, which will accelerate the convergence of GA. Two experimental examples were computed to test the convergence and local research ability of CGA. The experimental results show that CGA is of good convergences and good local research ability.
Convergent Rate of Genetic Algorithms with Arbitrary Encoding

Liang MING,Yu-ping WANG

DOI: https://doi.org/10.3321/j.issn:1000-6788.2006.03.013

2006-01-01

Abstract:At present, any mode for studying the convergence of genetic algorithm is limit. Thus, it is important and significant to study the convergence of genetic algorithms from another viewpoint, which can help build right stopping criteria and appropriate measure one for comprehensively and unbiasedly judging any algorithm. However, there are few results about convergence rate. Moreover, nearly all these results limit binary encoding genetic algorithms. In this paper, an upper bound on the rates of convergence to distributions of canonical genetic algorithms with arbitrary encoding is presented by using a special minorization condition, and effects of the population size, the encoding strength and the mutation probability on the convergence rate are given. It generalizes the existing results, and is of referenced value for designing algorithms.
Quantitative Analysis and Prevention of Genetic Algorithm Premature Convergence

WANG Min-le,GAO Xiao-guang,LIU Gang

DOI: https://doi.org/10.3321/j.issn:1001-506x.2006.08.037

2006-01-01

Abstract:To aim at the problem of genetic algorithm premature convergence,the new definition of premature convergence is given,and a new fuzzy index for measuring population maturity degree is presented on the basis of fuzzy system theory.Finally,the method of adaptively adjusting crossover probability and mutation probability with population maturity degree is proposed to prevent premature convergence,and its validity is verified through a simulation experiment.
On Convergence Rate of a Class of Genetic Algorithms

Liang Ming,Yuping Wang

DOI: https://doi.org/10.1109/wac.2006.376051

2007-01-01

Abstract:Studying convergence rate of a genetic algorithm is a very important but a nontrivial task. The more accurate estimation of convergence rate for genetic algorithms can be used to design the more efficient control parameters of algorithms, and to point out the correct direction to improve the algorithms. Moreover, one good measure of convergence rate can be used to judge the efficiency of different algorithms. The existing results about the convergence rate for genetic algorithms can be classified into two types. One type is based on Doeblin condition in which some parameters should be estimated. The other type needs to estimate the eigenvalues of the state transition matrix. However, these parameters are difficult to estimate. In this paper, we first formulate a model for a class of genetic algorithms, and then analyze the convergence rate of such an algorithm in a different way. It shows that their convergence rate is linear based on property of Markov chain.
On The Convergence Rates Of Genetic Algorithms

J He,Ls Kang

DOI: https://doi.org/10.1016/S0304-3975(99)00091-2

IF: 1.002

1999-01-01

Theoretical Computer Science

Abstract:This paper discusses the convergence rates of genetic algorithms by using the minorization condition in the Markov chain theory. We classify genetic algorithms into two kinds: one with time-invariant genetic operators, another with time-variant genetic operators. For the former case, we have obtained the bound on its convergence rate on the general state space; for the later case, we have bounded its convergence rate on the finite state space. (C) 1999 Published by Elsevier Science B.V. All rights reserved.
Convergence Analysis of Parallel Genetic Algorithm and Its Application to Optimization

戴晓明,许超,龚向阳,邵惠鹤

DOI: https://doi.org/10.3969/j.issn.1000-3428.2002.06.037

2002-01-01

Abstract:Canonical genetic algorithm applies a single population to optimize the functions. The super-individual during the early stage of evolving process can cause pre-maturity phenomenon. Coarse-grained Genetic Algorithm (CGGA) applies multi-population to optimize the objective problem. Different population evolves independently. The migration factor is introduced to the CGGA. The elite individual replaces the neighboring populations worst individual. The search process of CGGA is an ergodic homogeneous Markov chain. The global convergence proof of CGGA is presented in this paper. The NP-hard Traveling Salesman Problem (TSP) is cited as the benchmark problem to test the efficacy of the CGGA. The simulation result shows that CGGA holds faster convergence speed than the Canonical Genetic Algorithm(CGA).The inherent pre-mature problem can be greatly levied by CGGA.
A sufficient condition on the convergence of genetic algorithms in discrete space

Yanchun Liang,Zaishen Wang,Chunguang Zhou

IF: 1.019

1998-01-01

Chinese Journal of Electronics

Abstract:This paper analyzes the convergence of the genetic algorithms with selection and mutation operators alone and presents a sufficient condition that the evolutionary process converges to the global optimum in discrete space. The results of the theoretical analysis show that it can be ensured that the evolutionary process of the genetic algorithm without the crossover operation converges to the global optimum state as the mutation probability gets small enough.
The Unified Method Analyzing Convergence of Genetic Algorithms

Gongde Guo,Shuanghe Yu

2001-01-01

Abstract:This paper models the homogeneous finite Markov chain of the best individuals in the populations. Based on the limit distribution of transition probability that any state on the chain transfers into the state subset containing all global optima, a precise definition of the global convergence of genetic algorithms is presented regardless of the topologic structures of search landscapes. Two unified criterion theorems judging the global convergence are proposed and proved strictly, which are independent of encoding schemes and selection mechanisms. The results of analyzing the convergence of different genetic algorithms illustrate that the unified criterion theorems are generally practical and convenient.
Improving the Global Convergence of the Genetic Algorithm

何大阔,王福利

DOI: https://doi.org/10.3321/j.issn:1005-3026.2003.06.001

2003-01-01

Abstract:Based on the analysis of the reason of the early convergence of the genetic algo rithm, it was shown that the early convergence of the genetic algorithm is main ly concerned with the distribution of the solutions to the problem, the distribu tion of the individuals of the population and the application of the genetic ope rators. The key to improve the performance of the global convergence of the gen etic algorithms was believed to apply the algorithms to deal with the diversity of population scientifically and recognize the contribution of the individuals t o the global convergence. Several kinds of the individuals, which have much to d o with the performance of the global convergence, have been proposed and combine d with the niche evolution sharing function. A genetic algorithm is suggested to improve the global convergence of the genetic algorithms and to obtain the glob al optimal solution. Simulation results show that the new algorithm has good per formance on the global convergence.
Genetic Algorithms with Fitness- & Diversity-guided Adaptive Operating Probabilities and Analyses of its Convergence

Li Meiyi,Cai Zixing,Sun Guoyun

2004-01-01

Abstract:The paper has analyzed global convergence properties of adaptive genetic algorithms combining adaptive probabilities of crossover and mutation with diversity-guided crossover and mutation. By means of homogeneous finite Markov chains, it is proved that AGAD, which is present in this paper, and GAD (genetic algorithms with diversity-guided mutation) maintaining the best solution converge to the global optimum, which is the main contributions of this paper. The performance of AGA(adaptive genetic algorithms with adaptive probabilities of crossover and mutation), GAD and AGAD in optimizing several unimodal and multimodal functions has been compared. For multimodal functions, the AGAD converges to the global optimum for fewer generations than AGA and GAD, and it hardly has premature convergence. Key Diversity-guided mutation; Adaptive genetic algorithm; Markov chain analysis; Global convergence.
Mathematical Analysis of Mutation Operator and Its Improved Strategy in Genetic Algorithms

Zhang Liangjie,Mao Zhihong,Li Yanda

DOI: https://doi.org/10.1007/s11767-997-1008-2

1997-01-01

Journal of Electronics (China)

Abstract:This paper analyzes the optimization problem of mutation probability in genetic algorithms by applying the definition of i-bit improved sub-space. Then fuzzy reasoning technique is adopted to determine the optimal mutation probability in different conditions. The superior convergence property of the new method is evaluated by applying it to two simulation examples.
Convergence Analysis of Coarse-Grained Parallel Genetic Algorithm and Its Application to Optimization

戴晓明,陈昌领,邵惠鹤,Kay Das,程铁鹏,茅雪飞

DOI: https://doi.org/10.3321/j.issn:1006-2467.2003.04.007

2003-01-01

Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University

Abstract:Coarse-grained parallel genetic algorithm(CGGA) applies multi-population to optimize the objective problem. Different population is based on different coding schemes. The migration factor is introduced to the CGGA. The respective population's elite individual replaces the neighboring population's worst individual. The search process of CGGA is an ergodic homogeneous Markov chain. The global convergence proof of CGGA was presented. The simulation on the benchmark problems shows that the CGGA achieves better convergence performance than canonical genetic algorithm(CGA). The inherent premature convergence problem can be greatly levied by the CGA.
A theoretical analysis on mutation operator of standard genetic algorithm

Guo Li,Zongben Xu,l p guo

DOI: https://doi.org/10.1007/BF02900893

1996-01-01

Wuhan University Journal of Natural Sciences

Abstract:A theoretical analysis on the function of the mutation operator to GAs is developed, and the probability in which GAs converge to the premature set is also estimated. Our discussion indícates that mutation is necessary to GAs.
Amazing geometry of genetic space or are genetic algorithms convergent?

Marek W. Gutowski

DOI: https://doi.org/10.48550/arXiv.cs/0512019

2005-12-05

Neural and Evolutionary Computing

Abstract:There is no proof yet of convergence of Genetic Algorithms. We do not supply it too. Instead, we present some thoughts and arguments to convince the Reader, that Genetic Algorithms are essentially bound for success. For this purpose, we consider only the crossover operators, single- or multiple-point, together with selection procedure. We also give a proof that the soft selection is superior to other selection schemes.

Probability Convergence Theorems of Genetic Algorithms

Convergence Analysis of General Evolutionary Algorithms

Convergence Theorem of Genetic Algorithm

Almost Sure Convergence of Genetic Algorithms: A Martingale Approach

Further Results on Convergence Analysis of Genetic Algorithm s Based on Axiomatation Model

On the Mechanism and Convergence of Genetic Algorithm

ON THE CONVERGENCE OF REAL-CODED GENETIC ALGORITHMS

A Study of Compulsive Genetic Algorithm and Its Performance

Convergent Rate of Genetic Algorithms with Arbitrary Encoding

Quantitative Analysis and Prevention of Genetic Algorithm Premature Convergence

On Convergence Rate of a Class of Genetic Algorithms

On The Convergence Rates Of Genetic Algorithms

Convergence Analysis of Parallel Genetic Algorithm and Its Application to Optimization

A sufficient condition on the convergence of genetic algorithms in discrete space

The Unified Method Analyzing Convergence of Genetic Algorithms

Improving the Global Convergence of the Genetic Algorithm

Genetic Algorithms with Fitness- & Diversity-guided Adaptive Operating Probabilities and Analyses of its Convergence

Mathematical Analysis of Mutation Operator and Its Improved Strategy in Genetic Algorithms

Convergence Analysis of Coarse-Grained Parallel Genetic Algorithm and Its Application to Optimization

A theoretical analysis on mutation operator of standard genetic algorithm

Amazing geometry of genetic space or are genetic algorithms convergent?