The application of thin-layer gel filtration chromatography in the rapid assessment of protein-protein coupling reactions.

J. Kennedy,L. Kricka,P. Wilding

DOI: https://doi.org/10.1016/S0021-9673(00)82171-8

IF: 4.601

1976-04-01

Journal of Chromatography A

Abstract:

What problem does this paper attempt to address?

Modified Extremal Optimization for the Hard Maximum Satisfiability Problem

Guo-qiang Zeng,Yong-zai Lu,Wei-Jie Mao

DOI: https://doi.org/10.1631/jzus.c1000313

2011-01-01

Abstract:Based on our recent study on probability distributions for evolution in extremal optimization (EO), we propose a modified framework called EOSAT to approximate ground states of the hard maximum satisfiability (MAXSAT) problem, a generalized version of the satisfiability (SAT) problem. The basic idea behind EOSAT is to generalize the evolutionary probability distribution in the Bose-Einstein-EO (BE-EO) algorithm, competing with other popular algorithms such as simulated annealing and WALKSAT. Experimental results on the hard MAXSAT instances from SATLIB show that the modified algorithms are superior to the original BE-EO algorithm.
A novel stochastic method with modified extremal optimization and nearest neighbor search for hard combinatorial problems

Guo-Qiang Zeng,Yong-Zai Lu,Wei-Jie Mao

DOI: https://doi.org/10.1109/WCICA.2010.5554748

2010-01-01

Intelligent Control and Automation

Abstract:The combinatorial optimization occurs in many real-world problems including the fields of engineering, physics and economics. It has been recognized that some problems with highly degenerate states are difficult to solve in terms of many existing optimization algorithms. This paper proposes a novel stochastic method with modified extremal optimization (EO) and nearest neighbor search to deal with these problems. It starts from making use of the recent discovered statistical property to generate the initial configurations by the nearest neighbor search and then further explores the complex configuration spaces by a modified EO approach that applies more general probability distributions-based evolution mechanism. The experimental results with some hard instances of traveling salesman problem (TSP), a popular benchmark for combinatorial optimization problems demonstrate that the proposed method may provide better performance than other physics-inspired algorithms such as simulated annealing, EO and self-organized algorithm.
Nature's way of optimizing

Stefan Boettcher,Allon Percus

DOI: https://doi.org/10.1016/s0004-3702(00)00007-2

IF: 14.4

2000-05-01

Artificial Intelligence

Abstract:We propose a general-purpose method for finding high-quality solutions to hard optimization problems, inspired by self-organizing processes often found in nature. The method, called Extremal Optimization, successively eliminates extremely undesirable components of sub-optimal solutions. Drawing upon models used to simulate far-from-equilibrium dynamics, it complements approximation methods inspired by equilibrium statistical physics, such as Simulated Annealing. With only one adjustable parameter, its performance proves competitive with, and often superior to, more elaborate stochastic optimization procedures. We demonstrate it here on two classic hard optimization problems: graph partitioning and the traveling salesman problem.

computer science, artificial intelligence
Study on Probability Distributions for Evolution in Modified Extremal Optimization

Guo-Qiang Zeng,Yong-Zai Lu,Wei-Jie Mao,Jian Chu

DOI: https://doi.org/10.1016/j.physa.2009.12.055

IF: 3.778

2010-01-01

Physica A Statistical Mechanics and its Applications

Abstract:It is widely believed that the power-law is a proper probability distribution being effectively applied for evolution in tau-EO (extremal optimization), a general-purpose stochastic local-search approach inspired by self-organized criticality, and its applications in some NP-hard problems, e.g., graph partitioning, graph coloring, spill glass, etc. In this study, we discover that the exponential distributions or hybrid ones (e.g., power-laws with exponential cutoff) being popularly used in the research of network sciences may replace the original power-laws in a modified tau-EO method called self-organized algorithm (SOA), and provide better performances than other statistical physics oriented methods, such as simulated annealing, tau-EO and SOA etc., from the experimental results on random Euclidean traveling salesman problems (TSP) and non-uniform instances. From the perspective of optimization, our results appear to demonstrate that the power-law is not the only proper probability distribution for evolution in EO-similar methods at least for TSP, the exponential and hybrid distributions may be other choices. (C) 2010 Elsevier B.V. All rights reserved.
Finding Ground States of Sherrington-Kirkpatrick Spin Glass by Modified Extremal Optimization

Guo-Qiang Zeng,Yong-Zai Lu,Wei-Jie Mao

DOI: https://doi.org/10.1109/cise.2010.5677137

2010-01-01

Abstract:Finding the ground states of Sherrington-Kirkpatrick (SK) spin glass, the mean-filed spin glass model with strongly connected variables, is well known as a typical NP-hard problem. This paper presents a modified extremal optimization (EO) framework to approximate its grounds states. The basic idea behind the proposed framework is to generalize the evolutionary probability distribution of the original EO algorithm. The experimental results show that the modified EO algorithms provide better performances than the original one and further support the observation that power-law is not the only good evolutionary distribution in EO, others such as exponential and hybrid distributions may be better choices.
Backbone Guided Extremal Optimization For The Hard Maximum Satisfiability Problem

Guoqiang Zeng,Yongzai Lü,Yuxing Dai,Zhengguang Wu,Weijie Mao,Zhengjiang Zhang,Chongwei Zheng

2012-01-01

Abstract:The original Extremal Optimization (EO) algorithm and its modified versions have been successfully applied to a variety of NP-hard optimization problems. However, there exists a problem that almost all existing EO-based algorithms have overlooked the inherent structural properties behind the optimization problems, e.g., the backbone information. This paper proposes a novel stochastic search method called "Backbone Guided Extremal Optimization (BGEO)" to solve the hard maximum satisfiability (MAX-SAT) problem, one of typical NP-hard combinatorial optimization problems. The basic idea behind BGEO is to incorporate the backbone information into EO to guide the entire search process approaching the optimal solutions. The experimental results on many reported hard MAX-SAT instances have shown the superiority of BGEO to the reported EO-based algorithm without backbone information.
Improved Differential Evolution Algorithm and Application

LI Kai-bin,LU Jian-gang,WU Yan-ling,SUN You-xian

DOI: https://doi.org/10.3969/j.issn.1001-2265.2008.10.005

2008-01-01

Abstract:Differential evolution algorithm is very popular in recent years,it is widely used in complex optimization questions because of it's easy implementation and has less control parameters.But conventional differential evolution algorithm has a problem of stagnation that can stop the algorithm convergence.Aiming to solve the problem,another ending condition was proposed,also can change the number of population(N),variation coefficient(F) and crossover coefficient(CR) in computing process.Elite tactic was added to the computing process to quicken the convergence speed and make differential evolution algorithm converge to best solutions.Via computing typical testing function,the results computed by modified differential evolution algorithm are more excellent than conventional differential evolution algorithm and also converge more faster,so it proved the DE is very useful.
Evolutionary Learning: Advances in Theories and Algorithms

Zhi-Hua Zhou,Yang Yu,Chao Qian

DOI: https://doi.org/10.1007/978-981-13-5956-9

2019-01-01

Abstract:Many machine learning tasks involve solving complex optimization problems, such as working on non-differentiable, non-continuous, and non-unique objective functions; in some cases it can prove difficult to even define an explicit objective function. Evolutionary learning applies evolutionary algorithms to address optimization problems in machine learning, and has yielded encouraging outcomes in many applications. However, due to the heuristic nature of evolutionary optimization, most outcomes to date have been empirical and lack theoretical support. This shortcoming has kept evolutionary learning from being well received in the machine learning community, which favors solid theoretical approaches. Recently there have been considerable efforts to address this issue. This book presents a range of those efforts, divided into four parts. Part I briefly introduces readers to evolutionary learning and provides some preliminaries, while Part II presents general theoretical tools for the analysis of running time and approximation performance in evolutionary algorithms. Based on these general tools, Part III presents a number of theoretical findings on major factors in evolutionary optimization, such as recombination, representation, inaccurate fitness evaluation, and population. In closing, Part IV addresses the development of evolutionary learning algorithms with provable theoretical guarantees for several representative tasks, in which evolutionary learning offers excellent performance.
Optimistic variants of single-objective bilevel optimization for evolutionary algorithms

Anuraganand Sharma

DOI: https://doi.org/10.1142/S1469026820500200

2020-08-23

Abstract:Single-objective bilevel optimization is a specialized form of constraint optimization problems where one of the constraints is an optimization problem itself. These problems are typically non-convex and strongly NP-Hard. Recently, there has been an increased interest from the evolutionary computation community to model bilevel problems due to its applicability in the real-world applications for decision-making problems. In this work, a partial nested evolutionary approach with a local heuristic search has been proposed to solve the benchmark problems and have outstanding results. This approach relies on the concept of intermarriage-crossover in search of feasible regions by exploiting information from the constraints. A new variant has also been proposed to the commonly used convergence approaches, i.e., optimistic and pessimistic. It is called extreme optimistic approach. The experimental results demonstrate the algorithm converges differently to known optimum solutions with the optimistic variants. Optimistic approach also outperforms pessimistic approach. Comparative statistical analysis of our approach with other recently published partial to complete evolutionary approaches demonstrates very competitive results.

Neural and Evolutionary Computing,Artificial Intelligence
Adaptive Memetic Computing for Evolutionary Multiobjective Optimization

Vui Ann Shim,Kay Chen Tan,Huajin Tang

DOI: https://doi.org/10.1109/tcyb.2014.2331994

IF: 11.8

2014-01-01

IEEE Transactions on Cybernetics

Abstract:Inspired by biological evolution, a plethora of algorithms with evolutionary features have been proposed. These algorithms have strengths in certain aspects, thus yielding better optimization performance in a particular problem. However, in a wide range of problems, none of them are superior to one another. Synergetic combination of these algorithms is one of the potential ways to ameliorate their search ability. Based on this idea, this paper proposes an adaptive memetic computing as the synergy of a genetic algorithm, differential evolution, and estimation of distribution algorithm. The ratio of the number of fitter solutions produced by the algorithms in a generation defines their adaptability features in the next generation. Subsequently, a subset of solutions undergoes local search using the evolutionary gradient search algorithm. This memetic technique is then implemented in two prominent frameworks of multiobjective optimization: the domination- and decomposition-based frameworks. The performance of the adaptive memetic algorithms is validated in a wide range of test problems with different characteristics and difficulties.
Runtime Analysis of Competitive co-Evolutionary Algorithms for Maximin Optimisation of a Bilinear Function

Per Kristian Lehre

2024-03-17

Abstract:Co-evolutionary algorithms have a wide range of applications, such as in hardware design, evolution of strategies for board games, and patching software bugs. However, these algorithms are poorly understood and applications are often limited by pathological behaviour, such as loss of gradient, relative over-generalisation, and mediocre objective stasis. It is an open challenge to develop a theory that can predict when co-evolutionary algorithms find solutions efficiently and reliable. This paper provides a first step in developing runtime analysis for population-based competitive co-evolutionary algorithms. We provide a mathematical framework for describing and reasoning about the performance of co-evolutionary processes. An example application of the framework shows a scenario where a simple co-evolutionary algorithm obtains a solution in polynomial expected time. Finally, we describe settings where the co-evolutionary algorithm needs exponential time with overwhelmingly high probability to obtain a solution.

Neural and Evolutionary Computing,Populations and Evolution
A Surrogate Model Assisted Evolutionary Algorithm for Computationally Expensive Design Optimization Problems with Discrete Variables.

Bo Liu,Nan Sun,Qingfu Zhang,Georges Gielen,Vic Grout

DOI: https://doi.org/10.1016/j.jocs.2015.11.004

2016-01-01

Abstract:Real-world computationally expensive design optimization problems with discrete variables pose challenges to surrogate-based optimization methods in terms of both efficiency and search ability. In this paper, a new method is introduced, called surrogate model-aware differential evolution with neighbourhood exploration, which has two phases. The first phase adopts a surrogate-based optimization method based on efficient surrogate model-aware search framework, the goal of which is to reach at least the neighbourhood of the global optimum. In the second phase, a neighbourhood exploration method for discrete variables is developed and collaborates with the first phase to further improve the obtained solutions. Empirical studies on various benchmark problems and a real-world network-on-chip design optimization problem show the combined advantages in terms of efficiency and search ability: when only a very limited number of exact evaluations are allowed, the proposed method is not slower than one of the most efficient methods for the targeted problem; when more evaluations are allowed, the proposed method can obtain results with comparable quality compared to standard differential evolution, but it requires only 1% to 30% of exact function evaluations.
An Effective and Efficient Evolutionary Algorithm for Many-Objective Optimization

Yani Xue,Miqing Li,Xiaohui Liu

DOI: https://doi.org/10.1016/j.ins.2022.10.077

2022-10-25

Abstract:In evolutionary multiobjective optimization, effectiveness refers to how an evolutionary algorithm performs in terms of converging its solutions into the Pareto front and also diversifying them over the front. This is not an easy job, particularly for optimization problems with more than three objectives, dubbed many-objective optimization problems. In such problems, classic Pareto-based algorithms fail to provide sufficient selection pressure towards the Pareto front, whilst recently developed algorithms, such as decomposition-based ones, may struggle to maintain a set of well-distributed solutions on certain problems (e.g., those with irregular Pareto fronts). Another issue in some many-objective optimizers is rapidly increasing computational requirement with the number of objectives, such as hypervolume-based algorithms and shift-based density estimation (SDE) methods. In this paper, we aim to address this problem and develop an effective and efficient evolutionary algorithm (E3A) that can handle various many-objective problems. In E3A, inspired by SDE, a novel population maintenance method is proposed to select high-quality solutions in the environmental selection procedure. We conduct extensive experiments and show that E3A performs better than 11 state-of-the-art many-objective evolutionary algorithms in quickly finding a set of well-converged and well-diversified solutions.

Neural and Evolutionary Computing
Integral multiple interspike intervals of spontaneous activity in isolated medulla oblongata of frog

N. Takizawa

DOI: https://doi.org/10.1016/0006-8993(81)90479-0

IF: 3.61

1981-05-18

Brain Research

Abstract:
Introduction to Evolutionary Algorithms

S. Tamilselvi

DOI: https://doi.org/10.5772/intechopen.104198

2022-04-18

Abstract:Real-world has many optimization scenarios with multiple constraints and objective functions that are discontinuous, nonlinear, non-convex, and multi-modal in nature. Also, the optimization problems are multi-dimensional with mixed types of variables like integer, real, discrete, binary, and having a different range of values which demands normalization. Hence, the search space of the problem cannot be smooth. Evolutionary algorithms have started gaining attention and have been employed for computational processes to solve complex engineering problems. Because it has become an instrument for research scientists and engineers who need to apply the supremacy of the theory of evolution to shape any optimization-based research problems and articles. In this chapter, there is a comprehensive introduction to the optimization field with the state-of-the-art in evolutionary computation. Though many books have described such areas of optimization in any form as evolution strategies, genetic programming, genetic algorithms, and evolutionary programming, evolutionary algorithms, that is, evolutionary computation is remarkable for considering it to discuss in detail as a general class.
Differential evolution algorithms with novel mutations, adaptive parameters, and Weibull flight operator

Abdesslem Layeb

DOI: https://doi.org/10.1007/s00500-023-09561-3

IF: 3.732

2024-01-21

Soft Computing

Abstract:Differential evolution (DE) is among the best evolutionary algorithms for global optimization. However, the basic DE has several shortcomings, like the slow convergence speed, and it is more likely to be stuck at local optima. Additionally, DE's performance is sensitive to its mutation strategies and control parameters for mutation and crossover. In this scope, we present in this paper three mechanisms to overcome DE limitations. First, two novel mutations called DE/mean-current/2 and DE/best-mean-current/2 are proposed and integrated in the DE algorithm, and they have both exploration ability and exploitation trend. On the other hand, to avoid being trapped in local minima of hard functions, a new exploration operator has been proposed called Weibull flight based on the Weibull distribution. Finally, new adapted control parameters based on the Weibull distribution are integrated. These parameters contribute to the optimization process by adjusting mutation scale and alleviating the parameter setting problem often encountered in various metaheuristics. The efficacy of the proposed algorithms called meanDE, MDEW, AMDE, and AMDEW is validated through intensive experimentations using classical tests, some challenging tests, the CEC2017, CEC2020, the most recent CEC2022, four constraint engineering problems, and the data clustering problem. Moreover, comparisons with several popular, recent, and high-performance optimization algorithms show a high effectiveness of the proposed algorithms in locating the optimal or near-optimal solutions with higher efficiency. The experiments clearly indicate the effectiveness of the new mutations compared to the standard DE mutations. Moreover, the proposed Weibull flight has a great capacity to deal with the hard composition functions of CEC benchmarks. Finally, the use of adapted control parameters for the mutation scale helps overcome the parameter setting problem commonly encountered in various metaheuristics.

computer science, artificial intelligence, interdisciplinary applications
Coevolutionary Pareto Diversity Optimization

Aneta Neumann,Denis Antipov,Frank Neumann

DOI: https://doi.org/10.48550/arXiv.2204.05457

2022-04-12

Abstract:Computing diverse sets of high quality solutions for a given optimization problem has become an important topic in recent years. In this paper, we introduce a coevolutionary Pareto Diversity Optimization approach which builds on the success of reformulating a constrained single-objective optimization problem as a bi-objective problem by turning the constraint into an additional objective. Our new Pareto Diversity optimization approach uses this bi-objective formulation to optimize the problem while also maintaining an additional population of high quality solutions for which diversity is optimized with respect to a given diversity measure. We show that our standard co-evolutionary Pareto Diversity Optimization approach outperforms the recently introduced DIVEA algorithm which obtains its initial population by generalized diversifying greedy sampling and improving the diversity of the set of solutions afterwards. Furthermore, we study possible improvements of the Pareto Diversity Optimization approach. In particular, we show that the use of inter-population crossover further improves the diversity of the set of solutions.

Neural and Evolutionary Computing
Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research

Kay Chen Tan,Liang Feng,Min Jiang

DOI: https://doi.org/10.1109/mci.2020.3039066

IF: 9.809

2021-02-01

IEEE Computational Intelligence Magazine

Abstract:The evolutionary algorithm (EA) is a nature-inspired population-based search method that works on Darwinian principles of natural selection. Due to its strong search capability and simplicity of implementation, EA has been successfully applied to solve many complex optimization problems, which cannot be easily solved by traditional exact mathematical approaches, such as linear programming, quadratic programming, and convex optimization. Despite its great success, it is worth noting that traditional EA solvers start the search from scratch by assuming zero prior knowledge about the task at hand. However, as problems seldom exist in isolation, solving one problem may yield useful information for solving other related problems. There has been growing interest in conducting research on evolutionary transfer optimization (ETO) in recent years: a paradigm that integrates EA solvers with knowledge learning and transfer across related domains to achieve better optimization efficiency and performance. This paper provides an overview of existing works of ETO based on the type of problems being solved by these methods, which are ETO for Optimization in Uncertain Environment, ETO for Multitask Optimization, ETO for Complex Optimization, ETO for Multi/Many-Objective Optimization, and ETO for Machine Learning Applications. The paper also highlights some of the challenges faced in this emerging research field of computational intelligence and discusses some promising future research directions in ETO. It is hoped that the study presented in this paper can help to inspire the development of more advanced ETO methods and applications.

computer science, artificial intelligence
Elite-guided Resampling and Multi-mutation based Differential Evolution with exponential crossover for numerical optimization

Juncan Li,Zhenyu Meng

DOI: https://doi.org/10.1016/j.eswa.2024.125159

IF: 8.5

2024-09-01

Expert Systems with Applications

Abstract:In the existing Differential Evolution (DE) research, there are two main crossover schemes: exponential crossover and binomial crossover. Most researchers believe that binomial crossover is skilled in handling numerical optimization problems while exponential crossover has the advantage in handling optimization problems with certain correlation between adjacent variables. However, we discover that DE variants with exponential crossover can achieve performance comparable to advanced ones utilizing binomial crossover in optimization applications, provided that an appropriate crossover rate CR and associated parameter control are established. In this paper, an Elite-guided Resampling and Multi-mutation based DE with exponential crossover (ERM-DE) is raised to fill the blank in this field, and its main highlights are as follows: First, a novel structure with two stages is raised in our ERM-DE algorithm. The first stage is elite-guided global opposition learning based resampling, and the other is novel exponential crossover DE evolution stage. Second, a Novel Parameter Control (NPC) technique involving scale factor F and crossover rate CR is raised. Different from applying the fitness-based parameter control, the adaptation schemes of the parameters F and CR in our ERM-DE algorithm are fitness-independent. In addition, this NPC technique will also be selectively applied to the trial vector generation strategy DE/target-to- p best/1/exp with or without optional archive. Third, a novel population Diversity Enhancement Mechanism (DEM) is proposed, which can enhance population diversity by recalculating individuals in a stagnant state. Finally, a time stamp mechanism is posed to deal with outdated inferior and historical solutions in the external archive. A Large test suite with 88 benchmark functions from CEC2013, CEC2014, and CEC2017 test suites is used for algorithm validation and the experimental results indicate that our ERM-DE demonstrates competitiveness with several state-of-the-art DE variants.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science

The application of thin-layer gel filtration chromatography in the rapid assessment of protein-protein coupling reactions.

Modified Extremal Optimization for the Hard Maximum Satisfiability Problem

A novel stochastic method with modified extremal optimization and nearest neighbor search for hard combinatorial problems

Nature's way of optimizing

Study on Probability Distributions for Evolution in Modified Extremal Optimization

Finding Ground States of Sherrington-Kirkpatrick Spin Glass by Modified Extremal Optimization

Backbone Guided Extremal Optimization For The Hard Maximum Satisfiability Problem

Improved Differential Evolution Algorithm and Application

Evolutionary Learning: Advances in Theories and Algorithms

Optimistic variants of single-objective bilevel optimization for evolutionary algorithms

Adaptive Memetic Computing for Evolutionary Multiobjective Optimization

Runtime Analysis of Competitive co-Evolutionary Algorithms for Maximin Optimisation of a Bilinear Function

A Surrogate Model Assisted Evolutionary Algorithm for Computationally Expensive Design Optimization Problems with Discrete Variables.

An Effective and Efficient Evolutionary Algorithm for Many-Objective Optimization

Integral multiple interspike intervals of spontaneous activity in isolated medulla oblongata of frog

Introduction to Evolutionary Algorithms

Differential evolution algorithms with novel mutations, adaptive parameters, and Weibull flight operator

Coevolutionary Pareto Diversity Optimization

Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research

Elite-guided Resampling and Multi-mutation based Differential Evolution with exponential crossover for numerical optimization