Dynamic Optimization Mechanism Analysis of Evolutionary Programming

石立宝,徐国禹

DOI: https://doi.org/10.3969/j.issn.1000-0984.2002.05.002

2002-01-01

Abstract:In paper develops a dynamic optimiza tion differential equation model for exploiting and exploring the inherent opera tion mechanism of Evolutionary Programming Theoretical and numerical results sho w the correctness of the model, and obtain some meaningful conclusions.

What problem does this paper attempt to address?

Dynamic Optimization Mechanism Analysis of Evolutionary Programming Based on Differential Equation

LB Shi,GY Xu

DOI: https://doi.org/10.1109/wcica.2000.863189

2000-01-01

Abstract:Based on the population and the conception of online/off-line performances, this paper develops a dynamic optimization differential equation model for exploiting and exploring the inherent operation mechanism of evolutionary programming. Theoretical and numerical results obtained show the correctness of the model, and some meaningful conclusions are given
Optimization mechanism analysis of evolutionary programming based on a stochastic differential equation model.

Yongjin Tao,Libao Shi,Yixin Ni,Liangzhong Yao,Masoud Bazargan

DOI: https://doi.org/10.1109/SoCPaR.2011.6089131

2011-01-01

Abstract:As one of evolutionary algorithms, evolutionary programming (EP) has been successfully applied in the solutions of many complex optimization problems. However, little theoretical analysis is carried out to reveal the optimization mechanism of EP. In this paper, a novel stochastic differential equation model is proposed to explore and exploit the dynamic optimization process of EP in theory. The corresponding numerical analysis demonstrates the validity and effectiveness of the proposed model. © 2011 IEEE.
Mathematical Analysis of the Heuristic Optimisation Mechanism of Evolutionary Programming

Libao Shi,Zhao Yang Dong,Jin Hao,Kit Po Wong

DOI: https://doi.org/10.5019/j.ijcir.2006.73

2006-01-01

International Journal of Computational Intelligence Research

Abstract:Evolutionary algorithms are robust and adaptive. They have found a wide variety of applications solving optimisation and search problems. As one of the main stream algorithms in evolutionary computation evolutionary programming (EP) mainly uses real values of parameters. This makes it very attractive for many engineering optimisation applications. In addition to the evolutionary characteristics more in depth dynamic optimisation mechanisms of EP is investigated in this paper. An optimisation model based on differential equations is developed to explore and exploit the inherent optimal operation process of EP. The proposed model is based on the characteristics of population evolution and uses two performance measures, (i) Population On-line Performance measure and (ii) Population Off-line Performance measure. These two measures are used to quantify the dynamic population optimisation of EP and to form the foundation for the construction of the differential equation based optimisation model. The model is proposed with strict theoretical and numerical analysis. A number of important conclusions and observations are presented in accordance with the analytical results.
Application of Evolution Strategy Methods to Reactive Power Optimization of Power Systems

董峰,鞠平

DOI: https://doi.org/10.3321/j.issn:1000-1980.2000.05.007

2000-01-01

Abstract:Evolution strategy(ES) methods,which have many advantages,are applied to optimization of reactive power in power systems.The integer and continuous variables are dealt with different mutation approaches.Application results of show that the methods have good convergence and strong adaptation and facilitate the optimal solution.
Algebraic and Dynamic Analysis on the Modified Swarm Optimizers

Weidong Jiao,Yonghua Jiang,Jizhong Shi,Xiaoyan Wang,Shixi Yang

DOI: https://doi.org/10.1145/3036290.3036291

2017-01-01

Abstract:The modified particle swarm optimizers were proposed that use special velocity-updating modes and velocity-changing tracks to control velocity of evolved particles, and to tune the search process for the globally-optimal solution. Based on a reduced one-dimensional PSO system with only one particle, contrastive researches were made to interpret essential reasonability of the modified swarm optimizers, from both algebraic and dynamic viewpoint. Optimization example showed that the modified swarm optimizers are superior to the BPSO, on not only convergence precision but also computation expense.
An Improved Gene Expression Programming for Solving Inverse Problem

Kejun Zhang,Yuxia Hu,Gang Liu

DOI: https://doi.org/10.1109/wcica.2006.1712993

2006-01-01

Abstract:The basic principle of gene expression programming (GEP) is introduced in this paper. An improved GEP algorithm called IGEP based on dynamic mutation operator which dealing with the inverse problem of parameter identification of complex function is presented, the algorithm complexity of the IGEP was given in the paper, furthermore, many simulation results show that the models set up by the paper are better than the models set up by classic GEP. A future study will consider the effects of applying IGEP to the inverse problem which sensitive to the time period
Parameter Analysis Based on Stochastic Model for Differential Evolution Algorithm

Ling Wang,Fu-zhuo Huang

DOI: https://doi.org/10.1016/j.amc.2010.08.060

IF: 4.397

2010-01-01

Applied Mathematics and Computation

Abstract:In this paper, a stochastic model is used to describe and analyze the evolution process of differential evolution (DE) for numerical optimization. With the model, it illustrates how the probability distribution of the whole population is changed by mutation, selection and crossover operations. Based on the theoretical analysis, some guidelines about the parameter setting for DE are provided. In addition, numerical simulations are carried out to verify the conclusions drawn from model analysis.
An Improved Regularity-Based Vector Evolutionary Algorithm for Multi-Objective Optimizations.

Yiying Li,Shiyou Yang

DOI: https://doi.org/10.1016/j.advengsoft.2022.103397

IF: 4.255

2023-01-01

Advances in Engineering Software

Abstract:Inverse models-based evolutionary algorithms can generate as many solutions as required in interest regions at a low budget cost. However, the objective value used for the inverse model in the original regularity-based al-gorithm using Gaussian process-based inverse models, (IM-MOEA), is linearly and separately sampled for each objective according to its maximum and minimum values so far searched. Consequently, some non-optimal even infeasible solutions may be sampled. Also, the number of the predefined reference vectors remains constant throughout the whole evolution. Consequently, it may result in a low computational efficiency for multi-objective optimization ones (MOOs) with nonuniform or disconnected Pareto fronts. In this respect, an improved regularity-based vector evolutionary algorithm for multi-objective optimizations is presented in the paper. The main component of the proposed algorithm is to obtain the training data for inverse models by interpolation in the objective space. The population is divided into subpopulations according to the number of objectives. The non-dominated solutions are utilized for interpolations in each subpopulation. The inverse models are finally used to generate offspring using data by interpolation. An adaptive interpolation range co-efficient is proposed for adaptive adjustments of the interpolation region to balance the exploitation and the exploration searches. An elite strategy of hiring elite individuals in the whole population to the current sub-population is employed to enhance the algorithm convergence. Experimental results on two test suites show the superiority of the proposed algorithm.
Novel hybrid evolutionary algorithm for multi-objective optimization problem

Lin Zhang,Bin Ye,Quanyuan Jiang,Yijia Cao

2007-01-01

Abstract:A novel hybrid evolutionary algorithm based on Evolutionary Programming (EP) and Particle Swarm Optimization (PSO), named EPPSO, is presented for multi-objective optimization problem. The creature will grow up and become more suitable to the environment before producing offspring. To incorporate this phenomenon into EP, PSO is used to adapt the individuals before producing offspring. The mutation operator in EP effectively restrains the prematuity phenomenon of PSO aroused by the fast convergence, while the memory and collaboration characteristics of PSO help EP to converge faster. Furthermore, the adaptive grid algorithm is applied to the EPPSO to maintain the diversity of the Pareto front. The effectiveness of the proposed algorithm was demonstrated with test functions, and the results demonstrate the better Pareto front, the computation complexity reduction and the convergence efficiency improvement of the proposed algorithm.
SELF-ADAPTIVE EVOLUTIONARY PROGRAMMING AND ITS APPLICATION TO MULTI-OBJECTIVE OPTIMAL LOAD FLOW Part One Self-Adaptive Evolutionary Programming

Shi Libao,Xu Guoyu

DOI: https://doi.org/10.3321/j.issn:1000-1026.2000.07.006

2000-01-01

Abstract:Based on the combination of the general evolutionary programming and the mathematical theory, the paper develops a self-adaptive mutation operator and presents a new algorithm called self-adaptive evolutionary programming. The new algorithm includes two important procedures. The first, the expression designed for variance σ2 and the fitness f is inverse exponent. The second, the amount of mutation δ is self-adaptive during the optimization. The new method is applied to some mathematical test functions and the numerical results demonstrate the strong self-adaptability and versatility of the new algorithm.
An Evolutionary Algorithm Considering Gene Expression

周晴,李衍达

DOI: https://doi.org/10.3321/j.issn:0372-2112.2002.01.030

2002-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:The evolution of organisms takes place both in the genotype and the phenotype. At the phenotype level, the evolution is based on the laws of natural selection, while at the genotype level, it is a stochastic process of self-updating and self-optimization, and has a tendency of self-organizing to some degree. Based on this viewpoint of evolution, this paper proposes a new evolutionary algorithm and applies it to implement optimization. The algorithm considers not only natural selection of the phenotype, but also the evolution of genotype and the mappings between them. It is demonstrated by simulation results that the algorithm is much better than other evolutionary algorithms based on typical frames in the aspects of convergence speed, robustness and global optimization ability.
Evolution program for deterministic and stochastic optimizations

mitsuo gen,baoding liu,kenichi ida

DOI: https://doi.org/10.1016/0377-2217(95)00138-7

IF: 6.4

1996-01-01

European Journal of Operational Research

Abstract:This paper presents an evolution program for deterministic and stochastic optimizations. To overcome premature convergence and stalling of the solution, we suggest an exponential-fitness scaling scheme. To avoid the chromosomes jamming into a corner, we introduce mutation-1 which mutates the chromosomes in a free direction. To improve the chromosomes, we introduce mutation-2 which mutates the chromosomes in the gradient direction or its negative, according to the kind of problem. Monte Carlo simulation will be employed to solve the multiple integral which is the most difficult task in the stochastic optimization. Finally, some numerical examples are discussed.
Design of Optimization Platform Using Evolutionary Algorithm

LIU Hong-xing,ZHAO Ying,ZHU Bo,GAO Dun-tang

DOI: https://doi.org/10.3321/j.issn:1002-8331.2007.01.031

2007-01-01

Abstract:The optimization software,on linear programming and nonlinear programming,is playing more and more important role in social,economic and engineering areas.The current optimization software usually either employs classic local optimization techniques or adopts some simple global optimization techniques.In his paper,the evolutionary algorithm is introduced to the computation of optimization software,called optimization platform.The key procedure of the platform design is analyzed,and the scheme of the platform is proposed,and finally the platform is implemented.The features of the designed platform includes,dynamically adjusting the penalty factor related to the extended objective function at interface,using only two specially designed evolution operators,having a particular mechanism of parallel computing,and a going-back mechanism.With several tests,it was indicated that the implemented platform is easy to use,and can achieve precise solutions stably,having outstanding advantages,and so,the proposed scheme is satisfactory.
The Effect of Epigenetic Blocking on Dynamic Multi-Objective Optimisation Problems

Sizhe Yuen,Adam J. Sobey,Thomas H.G. Ezard

DOI: https://doi.org/10.48550/arXiv.2211.14222

2022-11-25

Neural and Evolutionary Computing

Abstract:Hundreds of Evolutionary Computation approaches have been reported. From an evolutionary perspective they focus on two fundamental mechanisms: cultural inheritance in Swarm Intelligence and genetic inheritance in Evolutionary Algorithms. Contemporary evolutionary biology looks beyond genetic inheritance, proposing a so-called ``Extended Evolutionary Synthesis''. Many concepts from the Extended Evolutionary Synthesis have been left out of Evolutionary Computation as interest has moved toward specific implementations of the same general mechanisms. One such concept is epigenetic inheritance, which is increasingly considered central to evolutionary thinking. Epigenetic mechanisms allow quick non- or partially-genetic adaptations to environmental changes. Dynamic multi-objective optimisation problems represent similar circumstances to the natural world where fitness can be determined by multiple objectives (traits), and the environment is constantly changing. This paper asks if the advantages that epigenetic inheritance provide in the natural world are replicated in dynamic multi-objective optimisation problems. Specifically, an epigenetic blocking mechanism is applied to a state-of-the-art multi-objective genetic algorithm, MOEA/D-DE, and its performance is compared on three sets of dynamic test functions, FDA, JY, and UDF. The mechanism shows improved performance on 12 of the 16 test problems, providing initial evidence that more algorithms should explore the wealth of epigenetic mechanisms seen in the natural world.
An accelerate Prediction Strategy for Dynamic Multi-Objective Optimization

Ru Lei,Lin Li,Rustam Stolkin,Bin Feng

2024-11-13

Abstract:This paper addresses the challenge of dynamic multi-objective optimization problems (DMOPs) by introducing novel approaches for accelerating prediction strategies within the evolutionary algorithm framework. Since the objectives of DMOPs evolve over time, both the Pareto optimal set (PS) and the Pareto optimal front (PF) are dynamic. To effectively track the changes in the PS and PF in both decision and objective spaces, we propose an adaptive prediction strategy that incorporates second-order derivatives to predict and adjust the algorithms search behavior. This strategy enhances the algorithm's ability to anticipate changes in the environment, allowing for more efficient population re-initialization. We evaluate the performance of the proposed method against four state-of-the-art algorithms using standard DMOPs benchmark problems. Experimental results demonstrate that the proposed approach significantly outperforms the other algorithms across most test problems.

Neural and Evolutionary Computing
A Genetic Evolutionary Programming

LIU Fang,LIU Min,WU Cheng

DOI: https://doi.org/10.3969/j.issn.1002-137x.2005.12.004

2005-01-01

Computer Science

Abstract:A genetic evolutionary programming is proposed in the paper,which combines the advantages of genetic al- gorithm and evolutionary programming.In the evolving process,the exchange rate and mutate rate of genetic algorithm and the mutate rules of evolutionary programming are changed self-adaptively according to evolution information of the population.It can not only keep the population diversity but also has quicker convergence speed.It is applied to integer programming.Computer simulation results show its validity.
Inverse Gaussian Process Modeling for Evolutionary Dynamic Multiobjective Optimization

Huan Zhang,Jinliang Ding,Min Jiang,Kay Chen Tan,Tianyou Chai

DOI: https://doi.org/10.1109/tcyb.2021.3070434

IF: 11.8

2021-01-01

IEEE Transactions on Cybernetics

Abstract:For dynamic multiobjective optimization problems (DMOPs), it is challenging to track the varying Pareto-optimal front. Most traditional approaches estimate the Pareto-optimal sets in the decision space. However, the obtained solutions do not necessarily satisfy the desired properties of decision makers in the objective space. Inverse model-based algorithms have a great potential to solve such problems. Nonetheless, the existing ones have low precision for handling DMOPs with nonlinear correlations between the objective and decision vectors, which greatly limits the application of the inverse models. In this article, an inverse Gaussian process (IGP)-based prediction approach for solving DMOPs is proposed. Unlike most traditional approaches, this approach exploits the IGP to construct a predictor that maps the historical optimal solutions from the objective space to the decision space. A sampling mechanism is developed for generating sample points in the objective space. Then, the IGP-based predictor is employed to generate an effective initial population by using these sample points. The proposed method by introducing IGP can obtain solutions with better diversity and convergence in the objective space, which is more responsive to the demand of decision makers than the traditional methods. It also has better performance than other inverse model-based methods in solving nonlinear DMOPs. To investigate the performance of the proposed approach, experiments have been conducted on 23 benchmark problems and a real-world raw ore allocation problem in mineral processing. The experimental results demonstrate that the proposed algorithm can significantly improve the dynamic optimization performance and has certain practical significance for solving real-world DMOPs.

automation & control systems,computer science, cybernetics, artificial intelligence
A Self-Adaptive Response Strategy for Dynamic Multiobjective Evolutionary Optimization Based on Objective Space Decomposition

Ruochen Liu,Jianxia Li,Yaochu Jin,Licheng Jiao

DOI: https://doi.org/10.1162/evco_a_00289

IF: 4.7662

2021-01-01

Evolutionary Computation

Abstract:Abstract Dynamic multiobjective optimization deals with simultaneous optimization of multiple conflicting objectives that change over time. Several response strategies for dynamic optimization have been proposed, which do not work well for all types of environmental changes. In this article, we propose a new dynamic multiobjective evolutionary algorithm based on objective space decomposition, in which the maxi-min fitness function is adopted for selection and a self-adaptive response strategy integrating a number of different response strategies is designed to handle unknown environmental changes. The self-adaptive response strategy can adaptively select one of the strategies according to their contributions to the tracking performance in the previous environments. Experimental results indicate that the proposed algorithm is competitive and promising for solving different DMOPs in the presence of unknown environmental changes. Meanwhile, the proposed algorithm is applied to solve the parameter tuning problem of a proportional integral derivative (PID) controller of a dynamic system, obtaining better control effect.

computer science, artificial intelligence, theory & methods
Balancing exploration and exploitation in multiobjective evolutionary optimization.

Jianyong Sun,Hu Zhang,Qingfu Zhang,Huanhuan Chen

DOI: https://doi.org/10.1145/3205651.3205708

2019-01-01

Abstract:Balancing exploration and exploitation is fundamental to the performance of an evolutionary algorithm. In this paper, we propose a survival analysis method to address this issue. Results of the analysis is used to adaptively choose appropriate new solution creation operators which prefer either exploration or exploitation. In the developed algorithm, a differential evolution recombination operator is used for the exploration purpose, while a new clustering-based operator is proposed for exploitation. Empirical comparison with four well-known multi-objective evolutionary algorithms on test instances with complex Pareto sets and Pareto fronts indicates the effectiveness and outperformance of the developed algorithms on these test instances in terms of commonly-used metrics.
Co-evolutionary algorithm based on problem analysis for dynamic multiobjective optimization

Xiaoli Li,Anran Cao,Kang Wang,Xin Li,Quanbo Liu

DOI: https://doi.org/10.1016/j.ins.2023.03.100

IF: 8.1

2023-07-01

Information Sciences

Abstract:Dynamic multiobjective optimization problems (DMOPs) vary over time, requiring an optimization algorithm to track the position of Pareto-optimal front (PF) in a dynamic environment. To achieve that, a novel co-evolutionary algorithm based on problem analysis (CAPA) is proposed in this paper. CAPA is designed to solve DMOPs from decision space and objective space simultaneously, which is achieved by the combination of adjustable prediction (AP) and precise mapping strategy (PM). In decision space, the proposed multi-model prediction can estimate the location of new population based on the historical median points. In objective space, a novel sampling method is developed to search for sample points with better convergence or diversity. Then, mapping these sample points back to decision space based on inverse model. Through the problem analysis mechanism, the proportion of the new solutions produced by each strategy changes adaptively. CAPA is incorporated into the dynamic multiobjective evolutionary algorithm (DMOEA) based on decomposition (MOEA/D) to construct a novel algorithm. The efficacy of CAPA is validated by comparison with five state-of-the-art algorithms on 28 benchmarks. Experimental results show that CAPA has the ability to generate high quality population uniformly along PF.

computer science, information systems

Dynamic Optimization Mechanism Analysis of Evolutionary Programming

Dynamic Optimization Mechanism Analysis of Evolutionary Programming Based on Differential Equation

Optimization mechanism analysis of evolutionary programming based on a stochastic differential equation model.

Mathematical Analysis of the Heuristic Optimisation Mechanism of Evolutionary Programming

Application of Evolution Strategy Methods to Reactive Power Optimization of Power Systems

Algebraic and Dynamic Analysis on the Modified Swarm Optimizers

An Improved Gene Expression Programming for Solving Inverse Problem

Parameter Analysis Based on Stochastic Model for Differential Evolution Algorithm

An Improved Regularity-Based Vector Evolutionary Algorithm for Multi-Objective Optimizations.

Novel hybrid evolutionary algorithm for multi-objective optimization problem

SELF-ADAPTIVE EVOLUTIONARY PROGRAMMING AND ITS APPLICATION TO MULTI-OBJECTIVE OPTIMAL LOAD FLOW Part One Self-Adaptive Evolutionary Programming

An Evolutionary Algorithm Considering Gene Expression

Evolution program for deterministic and stochastic optimizations

Design of Optimization Platform Using Evolutionary Algorithm

The Effect of Epigenetic Blocking on Dynamic Multi-Objective Optimisation Problems

An accelerate Prediction Strategy for Dynamic Multi-Objective Optimization

A Genetic Evolutionary Programming

Inverse Gaussian Process Modeling for Evolutionary Dynamic Multiobjective Optimization

A Self-Adaptive Response Strategy for Dynamic Multiobjective Evolutionary Optimization Based on Objective Space Decomposition

Balancing exploration and exploitation in multiobjective evolutionary optimization.

Co-evolutionary algorithm based on problem analysis for dynamic multiobjective optimization