Research development of evolutionary computation

Lixin Ding,Lishan Kang,YuPing Chen,Yuan Li

1998-01-01

Abstract:This paper presents a systemic introduction about history and present situations of evolutionary compution. The corresponding view-points are suggested with respect to foundations of theory, design principles, practical application level and connotation of evolutionary computation.

What problem does this paper attempt to address?

Research on methodology of evolutionary computing

Junfei Zhuo,Xinghe Wu,Guanzhao Wu,Min Yao

DOI: https://doi.org/10.4028/www.scientific.net/AMR.490-495.524

2012-01-01

Abstract:Evolutionary computing is one of the important branches in computational intelligence. This paper mainly introduces four new branches of the evolutionary computation, i.e. Gene Expression Programming (GEP), Particle Swarm Optimization (PSO), Differential Evolution (DE) and Estimation of Distribution Algorithms (EDA)
A Survey And Extension On Software Evolution And Computer-Aided Prototyping

J Ying,Zj He,C Chen,L Harn,M Harn

1999-01-01

Abstract:This paper gives a survey on the status of current research on software evolution and computer-aided prototyping system and furthermore, it puts forward an extensions on computer-aided software evolution and prototyping, that is to provide a framework for integrating software evolution activities.
Evolutionary Computation: Past, Present and Future

SUN Rui-Xiang,QU Liang-Sheng

2000-01-01

Abstract:This paper systematically reviews the history, the state-of-the-art, and the prospects of evolutionary computation(EC), a novel computing discipline rose in 1990's. Roughly speaking, EC is motivated from the principles of biological evolution and genetics. Now, it has been developed as one of the underpinning technologies for computational intelligence (CI), being the partnerships with artificial neural networks(ANN) and fuzzy logic(FL). From the viewpoint of application, EC is mainly applied to optimize the complicated industrial problems, which can not be tackled well with the traditional optimization methods. EC possesses many advantages over the conventional optimization techniques such as global optimization, independence of gradient, ease of implementation, and so on. Contemporarily, EC consists of the following avenues: genetic algorithms, genetic programming, evolution strategies, evolutionary programming, DNA computing, and molecular computing, etc. The rationales, similarities and differences, the application problems, and the puzzles of EC's avenues are formulated. At the end, the future promising research directions are prospected.
Summary of Genetic Algorithms Research

葛继科,邱玉辉,吴春明,蒲国林

DOI: https://doi.org/10.3969/j.issn.1001-3695.2008.10.008

2008-01-01

Abstract:This paper introduced the history,basic principle and main characters of genetic algorithms,discussed the theory,technology,limitation and improving measures about genetic algorithm.Then summarized the implementation techniques and applications of genetic algorithms,analyzed the research state of genetic algorithms in China during the past five years,and pointed out the genetic algorithms' research directions in the future.
Advances in Differential Evolution

LIU Bo,WANG Ling,JIN Yi-hui

DOI: https://doi.org/10.3321/j.issn:1001-0920.2007.07.001

2007-01-01

Abstract:As a novel evolutionary computing technique, differential evolution (DE) is simple and effective,which is paid wide attention and research in both academic and industry fields and achieves many successful applications.A complete survey on DE is presented in aspect of mechanism, feature, improvements and applications. The studies on DE aiming at complex environment are especially introduced including multi-objective, constrained, discrete and noisy optimization. Finally, the future research direction and contents are pointed out.
Special Issue on Theoretical Foundations of Evolutionary Computation

Per Kristian Lehre,Aneta Neumann,Chao Qian

DOI: https://doi.org/10.1016/j.tcs.2012.02.014

IF: 1.002

2023-01-01

Theoretical Computer Science

Abstract:Evolutionary computation methods, such as evolutionary algorithms or swarm intelligence algorithms, have been successfully applied to a wide range of difficult problems. These include classical NP-hard combinatorial optimization problems and a variety of hard real-world optimization problems. Real-world problems, in particular, are difficult to solve using traditional search methods because often ...
Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issues

Nan Li,Lianbo Ma,Guo Yu,Bing Xue,Mengjie Zhang,Yaochu Jin

DOI: https://doi.org/10.48550/arXiv.2208.10658

2022-08-23

Abstract:Over recent years, there has been a rapid development of deep learning (DL) in both industry and academia fields. However, finding the optimal hyperparameters of a DL model often needs high computational cost and human expertise. To mitigate the above issue, evolutionary computation (EC) as a powerful heuristic search approach has shown significant merits in the automated design of DL models, so-called evolutionary deep learning (EDL). This paper aims to analyze EDL from the perspective of automated machine learning (AutoML). Specifically, we firstly illuminate EDL from machine learning and EC and regard EDL as an optimization problem. According to the DL pipeline, we systematically introduce EDL methods ranging from feature engineering, model generation, to model deployment with a new taxonomy (i.e., what and how to evolve/optimize), and focus on the discussions of solution representation and search paradigm in handling the optimization problem by EC. Finally, key applications, open issues and potentially promising lines of future research are suggested. This survey has reviewed recent developments of EDL and offers insightful guidelines for the development of EDL.

Neural and Evolutionary Computing
A Survey on Recent Progress in the Theory of Evolutionary Algorithms for Discrete Optimization

Benjamin Doerr,Frank Neumann

DOI: https://doi.org/10.1145/3472304

2021-12-31

ACM Transactions on Evolutionary Learning and Optimization

Abstract:The theory of evolutionary computation for discrete search spaces has made significant progress since the early 2010s. This survey summarizes some of the most important recent results in this research area. It discusses fine-grained models of runtime analysis of evolutionary algorithms, highlights recent theoretical insights on parameter tuning and parameter control, and summarizes the latest advances for stochastic and dynamic problems. We regard how evolutionary algorithms optimize submodular functions, and we give an overview over the large body of recent results on estimation of distribution algorithms. Finally, we present the state of the art of drift analysis, one of the most powerful analysis technique developed in this field.
Development of Differential Evolution Algorithm

ZHOU Yan-ping,GU Xing-sheng

DOI: https://doi.org/10.3969/j.issn.1000-3932.2007.03.001

2007-01-01

Abstract:Aimed at a recently developed evolution algorithm,differential evolution(DE) algorithm,the principle,process and parameters of DE algorithm,and their influence on optimization performance of DE are introduced and analyzed systematically.Some experiences and rules on selection of control variable are summarized.Some improved DE and applications of DE algorithm are discussed in related domain.The theory and achievements in application prove the validity and advancement of DE algorithm.At last,further research issues and some suggestions are given.
A Survey on Distributed Evolutionary Computation

Wei-Neng Chen,Feng-Feng Wei,Tian-Fang Zhao,Kay Chen Tan,Jun Zhang

DOI: https://doi.org/10.48550/arXiv.2304.05811

2023-04-12

Neural and Evolutionary Computing

Abstract:The rapid development of parallel and distributed computing paradigms has brought about great revolution in computing. Thanks to the intrinsic parallelism of evolutionary computation (EC), it is natural to implement EC on parallel and distributed computing systems. On the one hand, the computing power provided by parallel computing systems can significantly improve the efficiency and scalability of EC. On the other hand, data are collected and processed in a distributed manner, which brings a novel development direction and new challenges to EC. In this paper, we intend to give a systematic review on distributed EC (DEC). First, a new taxonomy for DEC is proposed from top design mechanism to bottom implementation mechanism. Based on this taxonomy, existing studies on DEC are reviewed in terms of purpose, parallel structure of the algorithm, parallel model for implementation, and the implementation environment. Second, we clarify two major purposes of DEC, i.e., improving efficiency through parallel processing for centralized optimization and cooperating distributed individuals/sub-populations with partial information to perform distributed optimization. Third, noting that the latter purpose of DEC is an emerging and attractive trend for EC with the booming of spatially distributed paradigms, this paper gives a systematic definition of the distributed optimization and classifies it into dimension distributed-, data distributed-, and objective distributed-optimization problems. Formal formulations for these problems are provided and various DEC studies on these problems are reviewed. We also discuss challenges and potential research directions, aiming to enlighten the design of DEC and pave the way for future developments.
Epigenetic opportunities for evolutionary computation

Sizhe Yuen,Thomas H. G. Ezard,Adam J. Sobey

DOI: https://doi.org/10.1098/rsos.221256

IF: 3.5

2023-05-11

Royal Society Open Science

Abstract:Evolutionary computation is a group of biologically inspired algorithms used to solve complex optimization problems. It can be split into evolutionary algorithms, which take inspiration from genetic inheritance, and swarm intelligence algorithms, that take inspiration from cultural inheritance. However, much of the modern evolutionary literature remains relatively unexplored. To understand which evolutionary mechanisms have been considered, and which have been overlooked, this paper breaks down successful bioinspired algorithms under a contemporary biological framework based on the extended evolutionary synthesis, an extension of the classical, genetics focused, modern synthesis. Although the idea of the extended evolutionary synthesis has not been fully accepted in evolutionary theory, it presents many interesting concepts that could provide benefits to evolutionary computation. The analysis shows that Darwinism and the modern synthesis have been incorporated into evolutionary computation but the extended evolutionary synthesis has been broadly ignored beyond: cultural inheritance, incorporated in the sub-set of swarm intelligence algorithms, evolvability, through covariance matrix adaptation evolution strategy (CMA-ES), and multilevel selection, through multilevel selection genetic algorithm (MLSGA). The framework shows a gap in epigenetic inheritance for evolutionary computation, despite being a key building block in modern interpretations of evolution. This leaves a diverse range of biologically inspired mechanisms as low hanging fruit that should be explored further within evolutionary computation and illustrates the potential of epigenetic based approaches through the recent benchmarks in the literature.

multidisciplinary sciences
Research on Evolutionary Design Technology for Creative Product on Integrated Platform

FENG Yi-xiong,TAN Jian-rong,ZHANG Shu-you,MA Hui

DOI: https://doi.org/10.3969/j.issn.1006-5911.2006.01.001

2006-01-01

Computer Integrated Manufacturing Systems

Abstract:A new theory and method of innovative product evolutionary design based on semantics unit was presented.The new theory and method was discussed with evolutionary principles of design concepts and process in integrated platform from viewpoint of innovation and reuse properties for creative product.Key technologies,such as product motion evolutionary design,assembly evolutionary design,structure evolutionary design and reuse evolutionary design,were researched in particular.Furthermore,the new method has been successfully applied in the modeling of some projects and has achieved positive responses in its utility,flexibility and robustness.Experiment results indicated that this method could help designers express product design information more naturally and accurately from high-level semantics layer,and it has realized the support for computer-aided innovative design.
Journal of Computer Science and Technology: Preface

Xiaodong Li,Wenjian Luo,Xin Yao

DOI: https://doi.org/10.1007/s11390-008-9116-0

IF: 1.871

2009-01-01

Journal of Computer Science and Technology

Abstract:Some of the latest work done in the field of Evolution Algorithms are discussed. Evolutionary Algorithms (EA) using the same principles as of natural evolution can be used as powerful search and optimization methods. EAs are generic and robust optimization methods since they do not make any assumption about the underlying search space. The paper by Hu et al. proposes a novel Ant Colony Optimization (ACO) algorithm, Continuous Orthogonal Ant Colony (COAC), designed specifically for handling continuous optimization problems as opposed to the conventional ACO algorithms dealing with only discrete problems. The proposed algorithm incorporates the orthogonal design method, which is widely used as an experimental design method in scientific research. The paper by Ding et al. investigates the potential of employing a histogram probabilistic model in the continuous estimation of distribution algorithms (EDA).
Advanced techniques in evolutionary algorithms with applications to power systems

Yijia Cao,Quanyuan Jiang,Juan Fu

2003-01-01

Abstract:Evolutionary algorithms (EAs) are based on the underlying genetic process in biological organisms and on the natural evolution populations. Recently, EAs have found many potential applications in economical operation and control of power systems. However, when applying EAs to large scale system optimization problems, there is still a preeminent problem, the premature convergence problem, which degrade the EAs' performance. This paper presents an overview of the recent important techniques emerging in EAs' community with potential applications in power systems domains. These techniques covers both practical and theoretical considerations in self-adaptation and handling constraints. It is desired that they are helpful to the construction of some more efficient, robust EAs to solve a broader range of problems types in power systems.
Improved Differential Evolution Algorithm and Application

LI Kai-bin,LU Jian-gang,WU Yan-ling,SUN You-xian

DOI: https://doi.org/10.3969/j.issn.1001-2265.2008.10.005

2008-01-01

Abstract:Differential evolution algorithm is very popular in recent years,it is widely used in complex optimization questions because of it's easy implementation and has less control parameters.But conventional differential evolution algorithm has a problem of stagnation that can stop the algorithm convergence.Aiming to solve the problem,another ending condition was proposed,also can change the number of population(N),variation coefficient(F) and crossover coefficient(CR) in computing process.Elite tactic was added to the computing process to quicken the convergence speed and make differential evolution algorithm converge to best solutions.Via computing typical testing function,the results computed by modified differential evolution algorithm are more excellent than conventional differential evolution algorithm and also converge more faster,so it proved the DE is very useful.
Evolutionary Computation Meets Machine Learning: A Survey

Jun Zhang,Zhi-hui Zhan,Ying Lin,Ni Chen,Yue-jiao Gong,Jing-hui Zhong,Henry S. H. Chung,Yun Li,Yu-hui Shi

DOI: https://doi.org/10.1109/mci.2011.942584

IF: 9.809

2011-01-01

IEEE Computational Intelligence Magazine

Abstract:Evolutionary computation (EC) is a kind of optimization methodology inspired by the mechanisms of biological evolution and behaviors of living organisms. In the literature, the terminology evolutionary algorithms is frequently treated the same as EC. This article focuses on making a survey of researches based on using ML techniques to enhance EC algorithms. In the framework of an ML-technique enhanced-EC algorithm (MLEC), the main idea is that the EC algorithm has stored ample data about the search space, problem features, and population information during the iterative search process, thus the ML technique is helpful in analyzing these data for enhancing the search performance. The paper presents a survey of five categories: ML for population initialization, ML for fitness evaluation and selection, ML for population reproduction and variation, ML for algorithm adaptation, and ML for local search.
Evolutionary Automata and Deep Evolutionary Computation

Eugene Eberbach

2024-11-22

Abstract:Evolution by natural selection, which is one of the most compelling themes of modern science, brought forth evolutionary algorithms and evolutionary computation, applying mechanisms of evolution in nature to various problems solved by computers. In this paper we concentrate on evolutionary automata that constitute an analogous model of evolutionary computation compared to well-known evolutionary algorithms. Evolutionary automata provide a more complete dual model of evolutionary computation, similar like abstract automata (e.g., Turing machines) form a more formal and precise model compared to recursive algorithms and their subset - evolutionary algorithms. An evolutionary automaton is an automaton that evolves performing evolutionary computation perhaps using an infinite number of generations. This model allows for a direct modeling evolution of evolution, and leads to tremendous expressiveness of evolutionary automata and evolutionary computation. This also gives the hint to the power of natural evolution that is self-evolving by interactive feedback with the environment.

Neural and Evolutionary Computing,Computation and Language
Differential evolution: A recent review based on state-of-the-art works

Mohamad Faiz Ahmad,Nor Ashidi Mat Isa,Wei Hong Lim,Koon Meng Ang

DOI: https://doi.org/10.1016/j.aej.2021.09.013

IF: 6.626

2022-05-01

Alexandria Engineering Journal

Abstract:Differential evolution (DE) is a popular evolutionary algorithm inspired by Darwin's theory of evolution and has been studied extensively to solve different areas of optimisation and engineering applications since its introduction by Storn in 1997. This study aims to review the massive progress of DE in the research community by analysing the 192 articles published on this subject from 1997 to 2021, particularly studies in the past five years. The methodology used to search for relevant DE papers and an overview of the original DE are firstly explained. Recent advances in the modifications proposed to enhance the effectiveness and efficiency of the original DE are reviewed by analysing the strengths and weaknesses of each published work, followed by the potential applications of these DE variants in solving different real-world engineering problems. In contrast to most existing DE review papers, additional analyses are performed in this survey by investigating the impacts of various parameter settings on given DE variants to identify their optimal values required for solving certain problem classes. The qualities of modifications incorporated into selected DE variants are also evaluated by measuring the performance gains achieved in terms of search accuracy and/or efficiency against the original DE. The additional surveys conducted in this study are anticipated to provide more insightful perspectives for both beginners and experts of DE research, enabling their better understanding about current research trends and new motivations to outline appropriate strategic planning for future development works.

engineering, multidisciplinary
Evolutionary Computation Meets Deep Learning

Weiping Ding,Witold Pedrycz,Gary G. Yen,Bing Xue

DOI: https://doi.org/10.1109/TEVC.2021.3096336

IF: 16.497

2021-01-01

IEEE Transactions on Evolutionary Computation

Abstract:Deep learning is a timely research direction in machine learning, where breakthrough progress has been made in both academe and industries, bringing promising results in speech recognition, computer vision, industrial control and automation, etc. The motivation of deep learning is primarily to establish a model to simulate the neural connection structure of the human brain. While dealing with comp...
Learning to Learn Evolutionary Algorithm: A Learnable Differential Evolution

Xin Liu,Jianyong Sun,Qingfu Zhang,Zhenkun Wang,Zongben Xu

DOI: https://doi.org/10.1109/TETCI.2023.3251441

2023-01-01

IEEE Transactions on Emerging Topics in Computational Intelligence

Abstract:Research on evolutionary optimization has flourished for several decades. Now it has come to a turning point. With the advancement of artificial intelligence, especially deep learning and reinforcement learning, it is becoming appealing to rethink the design and development of evolutionary algorithm (EA). From our perspective, a new-generation EA should be <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">learned</i> rather than manually designed, based on learning from optimization experiences (such as obtained from optimizing a family of optimization problems), the deep understanding of the roles of recombination operators, and the usage of experiences extracted through history optimization trajectories, so as to intelligently decide the control parameters that can adapt to the problem landscape changes. This learning can be conducted by strongly coupling with reinforcement learning since an evolutionary search procedure can be modeled as a Markov Decision Process (MDP). In this paper we propose a framework for automatic learning of EA, and present an exemplar study on learning a differential evolution (DE). Experimental results show that the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">learned</i> adaptive DE is very competitive to some recent EAs on a commonly-used test suite, which indicates that the proposed learning framework has a great potential for the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">automatic</i> design of promising EAs.

Research development of evolutionary computation

Research on methodology of evolutionary computing

A Survey And Extension On Software Evolution And Computer-Aided Prototyping

Evolutionary Computation: Past, Present and Future

Summary of Genetic Algorithms Research

Advances in Differential Evolution

Special Issue on Theoretical Foundations of Evolutionary Computation

Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issues

A Survey on Recent Progress in the Theory of Evolutionary Algorithms for Discrete Optimization

Development of Differential Evolution Algorithm

A Survey on Distributed Evolutionary Computation

Epigenetic opportunities for evolutionary computation

Research on Evolutionary Design Technology for Creative Product on Integrated Platform

Journal of Computer Science and Technology: Preface

Advanced techniques in evolutionary algorithms with applications to power systems

Improved Differential Evolution Algorithm and Application

Evolutionary Computation Meets Machine Learning: A Survey

Evolutionary Automata and Deep Evolutionary Computation

Differential evolution: A recent review based on state-of-the-art works

Evolutionary Computation Meets Deep Learning

Learning to Learn Evolutionary Algorithm: A Learnable Differential Evolution