Group theory, group actions, evolutionary algorithms, and global optimization

Andrew Clark

DOI: https://doi.org/10.48550/arXiv.1301.0254

2012-12-27

Neural and Evolutionary Computing

Abstract:In this paper we use group, action and orbit to understand how evolutionary solve nonconvex optimization problems.

What problem does this paper attempt to address?

A New Evolutionary Algorithm for Unconstrained Nonlinear Global Optimization Problems and Its Convergence

Yuping Wang,EM Scattering

2002-01-01

Abstract:Evolutionary algorithm is a new kind of effective algorithms for very complex nonlinear programming problems. However,the amount of their computation is often large. To reduce the amount of the computation and make the algorithms more effective, the uniform design is used to design new effective evolution operator. The new evolution operator has the local-search property similar to that in traditional optimization techniques, thus it can generate a diversity of population and explore the search space effectively with little computation.Moreover,the new algorithm is globally convergent.The numerical results also show the effectiveness of the new algorithm with its less computation, higher convergent speed for all test functions.
Evolutionary Learning: Advances in Theories and Algorithms

Zhi-Hua Zhou,Yang Yu,Chao Qian

DOI: https://doi.org/10.1007/978-981-13-5956-9

2019-01-01

Abstract:Many machine learning tasks involve solving complex optimization problems, such as working on non-differentiable, non-continuous, and non-unique objective functions; in some cases it can prove difficult to even define an explicit objective function. Evolutionary learning applies evolutionary algorithms to address optimization problems in machine learning, and has yielded encouraging outcomes in many applications. However, due to the heuristic nature of evolutionary optimization, most outcomes to date have been empirical and lack theoretical support. This shortcoming has kept evolutionary learning from being well received in the machine learning community, which favors solid theoretical approaches. Recently there have been considerable efforts to address this issue. This book presents a range of those efforts, divided into four parts. Part I briefly introduces readers to evolutionary learning and provides some preliminaries, while Part II presents general theoretical tools for the analysis of running time and approximation performance in evolutionary algorithms. Based on these general tools, Part III presents a number of theoretical findings on major factors in evolutionary optimization, such as recombination, representation, inaccurate fitness evaluation, and population. In closing, Part IV addresses the development of evolutionary learning algorithms with provable theoretical guarantees for several representative tasks, in which evolutionary learning offers excellent performance.
Studies on Some Modern Optimization Algorithms

徐宁,李春光,张健,虞厥邦

DOI: https://doi.org/10.3321/j.issn:1001-506X.2002.12.030

2002-01-01

Abstract:Modern optimization includes genetic algorithm, ant colony algorithm and tabu search algorithm. They are mainly applied to solve difficult optimization problems. They are widely used independent of gradient, so they are suitable to solve large scale complicated problems which are unsolvable in traditional methods. This paper first introduces the basic ideas of these algorithms, and then gives their characteristics and comparison. Finally, future research directions are pointed out.\;
Cooperative Co-evolution with Soft Grouping for Large Scale Global Optimization

Weiming Liu,Yinda Zhou,Bin Li,Ke Tang

DOI: https://doi.org/10.1109/cec.2019.8790053

2019-01-01

Abstract:Cooperative Co-evolution (CC) is a promising framework to scale up conventional evolutionary algorithms for large scale global optimization (LSGO) problems. However, how to group decision variables is still a problem while there is no prior knowledge about the dependence relationship between variables. In this paper, a new kind of CC algorithm called Soft Grouping Cooperative Co-evolution (SGCC) is proposed to tackle the problem. Instead of explicitly dividing variables into multiple groups, the algorithm softly assigns variables into multiple groups by controlling the degree of membership of variables to the groups. In this work, the degree of membership is controlled by a probability distribution function. The experimental investigation shows that Soft Grouping CC is better than the explicit grouping CC on partially separable and non-separable problems.
Genetic Algorithms + Data Structures = Evolution Programs

Zbigniew Michalewicz

DOI: https://doi.org/10.1007/978-3-662-03315-9

1996-01-01

Abstract:Genetic algorithms are founded upon the principle of evolution, i.e., survival of the fittest. Hence evolution programming techniques, based on genetic algorithms, are applicable to many hard optimization problems, such as optimization of functions with linear and nonlinear constraints, the traveling salesman problem, and problems of scheduling, partitioning, and control. The importance of these techniques is still growing, since evolution programs are parallel in nature, and parallelism is one of the most promising directions in computer science. The book is self-contained and the only prerequisite is basic undergraduate mathematics. This third edition has been substantially revised and extended by three new chapters and by additional appendices containing working material to cover recent developments and a change in the perception of evolutionary computation.
A novel cooperative coevolution for large scale global optimization

Fei Wei,Yuping Wang,Tingting Zong

DOI: https://doi.org/10.1109/SMC.2014.6973998

2014-01-01

Abstract:For large scale global optimization problems, the efficiency and effectiveness of evolutionary algorithms (EAs) will be much reduced with the dimension increasing. In this paper, a novel evolutionary algorithm is proposed in order to improve the performance of EAs. In the proposed algorithm, on one hand, a variable grouping strategy is introduced. It can group all variables into several subcomponents, while the variables in each subcomponent are non-separable. In this way, a large scale problem can be decomposed into several small scale problems. On the other hand, a filled function with one parameter is integrated into EAs, which can help algorithm to escape from the current local optimal solution and find a better one. The simulations are made on the standard benchmark suite in CEC'2013, and the proposed algorithm is compared with several well performed algorithms. The results indicate the proposed algorithm is more efficient and effective.
Empirical Study Of Effect Of Grouping Strategies For Large Scale Optimization

Haiyan Liu,Yuping Wang,Xuyan Liu,Shiwei Guan

DOI: https://doi.org/10.1109/IJCNN.2016.7727639

2016-01-01

Abstract:The cooperative co-evolution framework (CC) is widely used in the large scale global optimization. It is believed that the CC framework is very sensitive to grouping strategies and the performance deteriorate if interacted variables are not correctly grouped. So many efforts have been devoted to find good ways to correctly decompose the large scale problem into smaller sub-problems so as to effectively solve the original problem by optimizing these smaller sub-problems using a search algorithm. However, what is the relationship between the grouping strategy and the search algorithm adopted in CC? what is the effect of grouping strategies on the CC framework? This work will tackle these issues. We try to unveil the impact of different grouping strategies on CC and the relationship between the grouping strategies and the search algorithms by empirical study. The experiment results show that the correct result of variable grouping is very important since it can turn the large scale problem into smaller sub-problems and make the problem solving easier. It indeed has a big influence on the results obtained by the search algorithm. However, when the search algorithm adopted is not suitable or effective, even if the grouping strategy gives the correct grouping results, the final results may be poor. In this case, grouping strategy only plays little role on the CC. Thus, only effective grouping strategy plus efficient search algorithm can result in good solutions for large global optimization problems.
Between theory and practice: guidelines for an optimization scheme with genetic algorithms - Part I: single-objective continuous global optimization

Loris Serafino

DOI: https://doi.org/10.48550/arXiv.1112.4323

2011-12-29

Abstract:The rapid advances in the field of optimization methods in many pure and applied science pose the difficulty of keeping track of the developments as well as selecting an appropriate technique that best suits the problem in-hand. From a practitioner point of view is rightful to wander "which optimization method is the best for my problem?". Looking at the optimization process as a "system" of intercon- nected parts, in this paper are collected some ideas about how to tackle an optimization problem using a class of tools from evolutionary computations called Genetic Algorithms. Despite the number of optimization techniques available nowadays the author of this paper thinks that Genetic Algorithms still play a central role for their versatility, robustness, theoretical framework and simplicity of use. The paper can be considered a "collection of tips" (from literature and personal experience) for the non-computer-scientist that has to deal with optimization problems both in the science and engineering practice. No original methods or algorithms are proposed.

Neural and Evolutionary Computing
Cooperative Co-evolution with Formula Based Grouping and CMA for Large Scale Optimization.

Haiyan Liu,Shiwei Guan,Fangjie Liu,Yuping Wang

DOI: https://doi.org/10.1109/CIS.2015.76

2015-01-01

Abstract:Cooperative co-evolution framework is widely used in large scale optimization problems. Usually, the large scale problem is divided into smaller sub groups using black-box decomposition methods based on variable interactions. However these black-box decomposition methods have limitations in finding correct variable interactions. In this paper, a white-box decomposition method named formula based grouping (FBG) is adopted and further improved. Also, we extend the covariance matrix adaptation to work with FBG under the cooperative co-evolution framework. Based on it, a new evolutionary algorithm is proposed for handling large scale optimization problems. The numerical experiments on CEC' 2013 benchmark suit shows the efficiency of the proposed algorithm.
Introduction to Evolutionary Algorithms

S. Tamilselvi

DOI: https://doi.org/10.5772/intechopen.104198

2022-04-18

Abstract:Real-world has many optimization scenarios with multiple constraints and objective functions that are discontinuous, nonlinear, non-convex, and multi-modal in nature. Also, the optimization problems are multi-dimensional with mixed types of variables like integer, real, discrete, binary, and having a different range of values which demands normalization. Hence, the search space of the problem cannot be smooth. Evolutionary algorithms have started gaining attention and have been employed for computational processes to solve complex engineering problems. Because it has become an instrument for research scientists and engineers who need to apply the supremacy of the theory of evolution to shape any optimization-based research problems and articles. In this chapter, there is a comprehensive introduction to the optimization field with the state-of-the-art in evolutionary computation. Though many books have described such areas of optimization in any form as evolution strategies, genetic programming, genetic algorithms, and evolutionary programming, evolutionary algorithms, that is, evolutionary computation is remarkable for considering it to discuss in detail as a general class.
A Smoothing Evolutionary Algorithm with Circle Search for Global Optimization

Yuping Wang,Lei Fan

DOI: https://doi.org/10.1109/nss.2010.92

2010-01-01

Abstract:There are many global optimization problems arisen in various fields of applications. It is very important to design effective algorithms for these problems. However, one of the key drawbacks of the existing global optimization methods is that they are not easy to escape from the local optimal solutions and can not find the global optimal solution quickly. In order to escape from the local optimal solutions and find the global optimal solution fast, first, a smoothing function, which can flatten the landscape of the original function and eliminate all local optimal solutions which are no better than the best one found so far, is proposed. This can make the search of the global optimal solution much easier. Second, to cooperate the smoothing function, a tailor-made search scheme called circle search is presented, which can quickly jump out the flattened landscape and fall in a lower landscape quickly. Third, a better solution than the best one found so far can be found by local search. Fourth, a crossover operator is designed based on uniform design. Based on these, a smoothing evolutionary algorithm for global optimization is proposed. At last, the numerical simulations for eight high dimensional and very challenging standard benchmark problems are made. The performance of the proposed algorithm is compared with that of nine evolutionary algorithms published recently. The results indicate that the proposed algorithm is statistically sound and has better performance for these test functions.
Global Group Search Optimizer Algorithm and Its Application Research

ZHANG Kang,GU Xing-sheng

DOI: https://doi.org/10.3969/j.issn.1672-6987.2012.05.019

2012-01-01

Abstract:The Group Search Optimizer(GSO) is a novel optimization algorithm,which is inspired by searching behavior of animals.In this paper we propose an improved GSO algorithm named Global Group Search Optimizer(GGSO) to balance the exploitation and exploration abilities of the algorithm.At first time,an improved search equation with an acceleration coefficient for the scroungers motion model is developed,which accelerates the moving speed of the scroungers toward the producer to improve the exploitation power.After that,a mutation operation using Gaussian function is introduced to enhance the rangers searching area which improve the exploration ability.The GGSO algorithm is evaluated on a set of 11 un-constrained numerical optimization problems and 3 constrained problems and compares favorably with the basic version of GSO.Experimental results indicate that the GGSO algorithm improves the performance on these problems significantly,and prove that the GGSO algorithm can be implied on practical problems.
All You Need is Group Actions: Advancing Robust Autonomous Planning

Vincenzo Basco

2024-08-30

Abstract:Managing the plan of constellation of satellites for target observation requires optimal deployment and efficient operational strategies. In this paper, we introduce a new technique based on group theory tools through multi-agent constraint optimization techniques, designed for the dynamic landscapes of satellite operations. Inspired by group actions, our method models the planning problem for observing Earth targets as a cooperative game to achieve computational efficiency while simultaneously reducing computational complexity. Designed for the complex task of planning constellation of satellites, our methodology provides a feasible solution to the inherent challenges of multi-agent optimization under state constraints and subject to uncertainties. Our approach can offer avenues for improving mission efficiency and reducing costs. Through numerical simulations, we demonstrate the good performance of the approach in the presence of inter-satellite links.

Optimization and Control,Group Theory,Numerical Analysis
A Cooperative Group Optimization System

Xiao-Feng Xie,Jiming Liu,Zun-Jing Wang

DOI: https://doi.org/10.1007/s00500-013-1069-8

2018-08-04

Abstract:A cooperative group optimization (CGO) system is presented to implement CGO cases by integrating the advantages of the cooperative group and low-level algorithm portfolio design. Following the nature-inspired paradigm of a cooperative group, the agents not only explore in a parallel way with their individual memory, but also cooperate with their peers through the group memory. Each agent holds a portfolio of (heterogeneous) embedded search heuristics (ESHs), in which each ESH can drive the group into a stand-alone CGO case, and hybrid CGO cases in an algorithmic space can be defined by low-level cooperative search among a portfolio of ESHs through customized memory sharing. The optimization process might also be facilitated by a passive group leader through encoding knowledge in the search landscape. Based on a concrete framework, CGO cases are defined by a script assembling over instances of algorithmic components in a toolbox. A multilayer design of the script, with the support of the inherent updatable graph in the memory protocol, enables a simple way to address the challenge of accumulating heterogeneous ESHs and defining customized portfolios without any additional code. The CGO system is implemented for solving the constrained optimization problem with some generic components and only a few domain-specific components. Guided by the insights from algorithm portfolio design, customized CGO cases based on basic search operators can achieve competitive performance over existing algorithms as compared on a set of commonly-used benchmark instances. This work might provide a basic step toward a user-oriented development framework, since the algorithmic space might be easily evolved by accumulating competent ESHs.

Neural and Evolutionary Computing
Cooperative Co-evolution Algorithm with Problem Adaptive Variable Grouping for Large Scale Global Optimization

Fei Wei,Shugang Li,Jinfeng Xue

2018-01-01

Abstract:For large scale global optimization problems, evolutionary algorithms (briefly, EAs) will face a huge challenge, and their efficiency and effectiveness will be much reduced. To enhance their efficiency and effectiveness, in this paper, a problem adaptive variable grouping strategy (briefly, PAVG) is firstly proposed. In PAVG, we make the grouping directly via the expression of the objective function which usually consists of finite number of operations of four arithmetic operations “ + , − , 2 f , ÷ ” and composite operation of basic elementary functions. We classify these operations into two classes: one will result in non-separable variables, and the other will result in separable variables. In this way, the variables can be grouped into several non-interacting subcomponents, while the variables in each subcomponent are interactive. Then, combining with PAVG, a novel algorithm, called cooperative co-evolution algorithm with problem adaptive variable grouping strategy (briefly, CCPA), is designed, and evolution can be conducted in these subcomponents separately. In this way, a large-scale problem can be decomposed into several small-scale problems and this makes the problem solving much easier. To further enhance the efficiency of CCPA, a new local search scheme is designed, and when a good solution is found in the evolution process (e.g., by crossover and mutation), it will be further improved by the local search scheme. To verify the efficiency of CCPA, the simulations are made on the standard benchmark suites of CEC’2010 and CEC’2013, and CCPA is compared with several well performed algorithms. The results indicate that the proposed algorithm CCPA is more efficient and effective.
Global optimization using evolutionary algorithm based on level set evolution and latin square

Yuping Wang,Jinling Du,Chuangyin Dang

DOI: https://doi.org/10.1007/11508069_70

2005-01-01

Abstract:In this paper, a new crossover operator based on Latin square design is presented at first. This crossover operator can generate a set of uniformly scattered offspring around their parents, and it is of the ability of local search and thus can explore the search space efficiently. Then the level set of the objective function is evolved successively by crossover and mutation operators such that it gradually approaches to global optimal solution set. Based on these, a new evolutionary algorithm for nondifferentiable unconstrained global optimization is proposed and its global convergence is proved. At last, the numerical simulations are made for some standard test functions. The performance of the proposed algorithm is compared with that of two widely-cited algorithms. The results indicate the proposed algorithm is effective and has better performance than the compared algorithms for these test functions.
A New Evolutionary Algorithm For A Class Of Nonlinear Bilevel Programming Problems And Its Global Convergence

Yuping Wang,Hong Li,Chuangyin Dang

DOI: https://doi.org/10.1287/ijoc.1100.0430

IF: 3.288

2011-01-01

INFORMS Journal on Computing

Abstract:When the leader's objective function of a nonlinear bilevel programming problem is nondifferentiable and the follower's problem of it is nonconvex, the existing algorithms cannot solve the problem. In this paper, a new effective evolutionary algorithm is proposed for this class of nonlinear bilevel programming problems. First, based on the leader's objective function, a new fitness function is proposed that can be easily used to evaluate the quality of different types of potential solutions. Then, based on Latin squares, an efficient crossover operator is constructed that has the ability of local search. Furthermore, a new mutation operator is designed by using some good search directions so that the offspring can approach a global optimal solution quickly. To solve the follower's problem efficiently, we apply some efficient deterministic optimization algorithms in the MATLAB Toolbox to search for its solutions. The asymptotically global convergence of the algorithm is proved. Numerical experiments on 25 test problems show that the proposed algorithm has a better performance than the compared algorithms on most of the test problems and is effective and efficient.
Kinetic description and convergence analysis of genetic algorithms for global optimization

Giacomo Borghi,Lorenzo Pareschi

2023-10-13

Abstract:Genetic Algorithms (GA) are a class of metaheuristic global optimization methods inspired by the process of natural selection among individuals in a population. Despite their widespread use, a comprehensive theoretical analysis of these methods remains challenging due to the complexity of the heuristic mechanisms involved. In this work, relying on the tools of statistical physics, we take a first step towards a mathematical understanding of GA by showing how their behavior for a large number of individuals can be approximated through a time-discrete kinetic model. This allows us to prove the convergence of the algorithm towards a global minimum under mild assumptions on the objective function for a popular choice of selection mechanism. Furthermore, we derive a time-continuous model of GA, represented by a Boltzmann-like partial differential equation, and establish relations with other kinetic and mean-field dynamics in optimization. Numerical experiments support the validity of the proposed kinetic approximation and investigate the asymptotic configurations of the GA particle system for different selection mechanisms and benchmark problems.

Optimization and Control
Efficient evolutionary algorithm for unconstraint global optimization

WANG Wei,ZHAO Wen-hong,WANG Yu-ping

2010-01-01

Abstract:In solving global optimization problems,evolutionary algorithms converge slowly and tend to be trapped in local optimal solutions.A crossover operator is designed which searches the descent-directions based on the relationship between the best individual and the others in the population.Once it finds an individual better than the best one in the population,the objective function is further optimized by using the projection of the intersection of two constructed lines,so that the function can decrease faster.A method is presented to generate the initial population for the crossover operator.To improve the performance of the algorithm,a mutation operator which increases the convergence rate and avoids to be trapped in the local optima is given.Based on all these,an evolutionary algorithm for global optimization is proposed and its global convergence is proved.Numerical results show the efficiency of the proposed algorithm for all test functions.
Deep Evolution Algorithm under Competitive and Cooperative Behavior

CHEN Haijuan,FENG Xiang,YU Huiqun

DOI: https://doi.org/10.3778/j.issn.1673-9418.1905088

2020-01-01

Abstract:Combining depth with evolutionary algorithms, a deep evolutionary algorithm, the group competition cooperation optimization (GCCO) algorithm, is proposed. Firstly, the bio-group model is introduced to simulate the natural phenomenon that groups search prey. The algorithm can easily solve the optimization problem through multi-step iteration. In bio-group model, the follower adopts a variable step size region replication method to balance the convergence speed and optimization precision. The wanderer adopts random walk mode based on feature transfor-mation to avoid local optimization. Secondly, the introduction of competition model and cooperation model increases the complexity of the algorithm, and improves the search performance of the algorithm through competition and information sharing among groups. In addition, the mathematical model of the algorithm is derived from group theory, dynamics and imperial competition theory. The convergence of the algorithm is also verified theoretically. Finally, the performance of the proposed algorithm is tested through comparing it with the other three optimization algorithms on ten optimization benchmark functions. At the same time, GCCO achieves better results than other algorithms in setting up gas stations in Shanghai to improve the on-time rate.

Group theory, group actions, evolutionary algorithms, and global optimization

A New Evolutionary Algorithm for Unconstrained Nonlinear Global Optimization Problems and Its Convergence

Evolutionary Learning: Advances in Theories and Algorithms

Studies on Some Modern Optimization Algorithms

Cooperative Co-evolution with Soft Grouping for Large Scale Global Optimization

Genetic Algorithms + Data Structures = Evolution Programs

A novel cooperative coevolution for large scale global optimization

Empirical Study Of Effect Of Grouping Strategies For Large Scale Optimization

Between theory and practice: guidelines for an optimization scheme with genetic algorithms - Part I: single-objective continuous global optimization

Cooperative Co-evolution with Formula Based Grouping and CMA for Large Scale Optimization.

Introduction to Evolutionary Algorithms

A Smoothing Evolutionary Algorithm with Circle Search for Global Optimization

Global Group Search Optimizer Algorithm and Its Application Research

All You Need is Group Actions: Advancing Robust Autonomous Planning

A Cooperative Group Optimization System

Cooperative Co-evolution Algorithm with Problem Adaptive Variable Grouping for Large Scale Global Optimization

Global optimization using evolutionary algorithm based on level set evolution and latin square

A New Evolutionary Algorithm For A Class Of Nonlinear Bilevel Programming Problems And Its Global Convergence

Kinetic description and convergence analysis of genetic algorithms for global optimization

Efficient evolutionary algorithm for unconstraint global optimization

Deep Evolution Algorithm under Competitive and Cooperative Behavior