A Population-Based Incremental Learning Vector Algorithm for Multiobjective Optimal Designs

Ho, S.L.,Shiyou Yang

DOI: https://doi.org/10.1109/cefc.2010.5481850

2010-01-01

Abstract:A vector optimizer, based on population based incremental learning (PBIL) method, is proposed and used to study a hard engineering inverse problem with good results.

What problem does this paper attempt to address?

A Population-Based Incremental Learning Vector Algorithm For Multiobjective Optimal Designs

Siulau Ho,Shiyou Yang,Weinong Fu

DOI: https://doi.org/10.1109/TMAG.2010.2093571

IF: 1.848

2011-01-01

IEEE Transactions on Magnetics

Abstract:To alleviate the deficiency of crossover and mutation operations in standard genetic algorithms, the population-based incremental learning (PBIL) method is extended for multiobjective designs of inverse problems. To quantitatively measure the number of improvements in the whole objective functions and to quantify the amount of improvements in a specific objective function, a novel metric is proposed to "penalize" the fitness of a solution. Moreover, a selecting strategy for the best solutions of the latest iterations of an individual is introduced. Furthermore, multiple probability vectors are employed to enhance the diversity of the found solutions. Numerical experiments on low- and high-frequency inverse problems are carried out to demonstrate the feasibility of the proposed vector PBIL algorithm for hard multiobjective engineering inverse problems.
A Population-Based Incremental Learning Method for Robust Optimal Solutions

S. L. Ho,Shiyou Yang

DOI: https://doi.org/10.1109/tmag.2010.2043650

IF: 1.848

2010-01-01

IEEE Transactions on Magnetics

Abstract:A population-based incremental learning (PBIL) method is proposed to search for both robust and global optimal solutions of an inverse problem in which there are inevitable tolerances on the decision variables. To reduce the computational costs of the proposed algorithm, a methodology for evaluating the expectancy measures and a philosophy for worst-case solutions are proposed. Moreover, a novel mechanism for selecting the performance metrics is introduced to enable the algorithm to find both global and robust optimal solutions in a single run. Two numerical examples are reported to validate the proposed algorithm.
A Real Coded Vector Population-Based Incremental Learning Algorithm for Multi-Objective Optimizations of Electromagnetic Devices

S. L. Ho,Jiaqiang Yang,Shiyou Yang,Yanan Bai

DOI: https://doi.org/10.1109/TMAG.2017.2766158

IF: 1.848

2018-01-01

IEEE Transactions on Magnetics

Abstract:Even though evolutionary algorithm (EA) has now become the standard and paradigm for solving multi-objective design problems, the complexity of its genetic operation is, however, limiting its popularity in engineering applications. Hitherto, there has been insufficient research that addresses the inadequacy of EAs in extracting the characteristic landscape features of an objective function. Howeve...
A New Implementation of Population Based Incremental Learning Method for Optimizations in Electromagnetics

S. Y. Yang,S. L. Ho,G. Z. Ni,Jose Marcio Machado,K. F. Wong

DOI: https://doi.org/10.1109/tmag.2006.892112

2007-01-01

Abstract:To enhance the global search ability of population based incremental learning (PBIL) methods, it is proposed that multiple probability vectors are to be included on available PBIL algorithms. The strategy for updating those probability vectors and the negative learning and mutation operators are thus re-defined correspondingly. Moreover, to strike the best tradeoff between exploration and exploitation searches, an adaptive updating strategy for the learning rate is designed. Numerical examples are reported to demonstrate the pros and cons of the newly implemented algorithm.
An Adaptive Real Coded Population-Based Incremental Learning Algorithm for Design Optimizations in Continuous Space

Jian Yang,Yong Zhang,Linggang Zhou,Xin Lv,Yuntu Jiang,Qiuxiao Wang,Shiyou Yang

DOI: https://doi.org/10.1109/CIYCEE59789.2023.10401742

2023-01-01

Abstract:In a traditional evolutionary algorithm, the selection, crossover, and mutation are commonly used to evolve its searching procedure. For a robust and feasible evolutionary algorithm, these operators must be properly designed. Nevertheless, the proper design of these operators is not an easy task. On the other hand, it would be preferable for an algorithm that the previously explored solutions can be used to help the creation of new solutions or states. In this point of view, evolutionary methods using probabilistic models are deserved further attentions. The Population-Based Incremental Learning (PBIL) algorithm can be categorized into this type of algorithms. The PBIL is initially developed as a binary coded algorithm, and is awkward to some extent in applying to solve a design problem with continuous variables. In this respect, an adaptive continuous PBIL is introduced. In the newly improved PBIL method, an automatic mechanism is presented to update the probability matrix, which is adopted to stochastically produce the offspring, to obtain a balance among the fast convergence and the high quality final solution. Two examples are numerically solved by the introduced PBIL method to highlight its advantages and deficiencies.
An Improved Population-Based Incremental Learning Method For Inverse Problems

Shiyou Yang,Yanan Bai,GuoHong Zhang,Lie Wu

2008-01-01

Abstract:To eliminate the use of complex operators such as crossover and mutation ones in genetic algorithms, attempts are made to exploit the use of population based incremental learning (PBIL) evolution algorithm. In order to preserve the global search ability without destroying the conceptual simplicity and implementation easiness of existing PBIL methods, some improvements are proposed in this paper. The major enhancements include the use of the best solution in the current iterative cycle to guide the search towards promising regions, the employment of the worst solution to shift the search away from the worst individuals to speed up the convergence, and the introduction of a novel mechanism for generating new individuals to improve the global search ability. To validate and illustrate the merits of the proposed PBIL algorithm, two different optimal design problems are studied, and the numerical results are reported and compared in the paper.
A Tabu Based Vector Optimal Algorithm Applied to Multiobjective Designs of Electromagnetic Devices

QY Ren,HY Zhang,YN Bai,PH Ni,JM Machado,GZ Ni

2003-01-01

Abstract:A tabu based vector optimal algorithm to seek the Pareto front of multiobjective designs of electromagnetic devices is introduced in this paper. As a general rule, an efficient solver for multiobjective optimization problems should have the following features: the solutions obtained are Pareto optimal, and the solutions are uniformly sampled from the Pareto optimal set. To achieve these two goals, different approaches; including the introduction of the parameter and objective strings, the ranking concept, and an intensification phase; the new termination criterion; as well as the new neighborhood generation scheme; are proposed. Computer simulation results are reported to demonstrate the robustness of the proposed algorithm for both obtaining and uniformly sampling the Pareto optimal front of the multiobjective optimal design problems.
A Computationally Efficient Vector Optimizer Using Ant Colony Optimizations Algorithm for Multobjective Designs

Siu-Lau Ho,Shiyou Yang

DOI: https://doi.org/10.1109/tmag.2007.914864

IF: 1.848

2008-01-01

IEEE Transactions on Magnetics

Abstract:An efficient vector optimizer is proposed based on the hybridization of an ant colony optimization method and a novel exploiting search mechanism. To inherit the learning and searching power of an ant colony algorithm while excluding the usage of a tedious and awkward pheromone updating scheme, it is proposed that an algorithm that models the foraging strategy of pachycodyla apicalis ants is employed and modified. In order to yield better Pareto solutions, the gradient balance concept is used to design the exploitation search process in which some a priori information about the characteristics of the objective functions is used in the selection of nests for subsequent intensifying searches. Numerical experiments are reported to validate the merits and advantages of the proposed vector optimizer for solving practical engineering design problems.
A Robust Metaheuristic Combining Clonal Colony Optimization and Population-Based Incremental Learning Methods

Siu Lau Ho,Shiyou Yang,Yanan Bai,Jin Huang

DOI: https://doi.org/10.1109/tmag.2013.2283886

IF: 1.848

2014-01-01

IEEE Transactions on Magnetics

Abstract:To provide a fast robust optimizer for numerical solutions of inverse problems, a metaheuristic combining a clonal colony optimization methodology and a population based incremental learning method is proposed. In the proposed algorithm, a real-valued probability vector is introduced for the extension of each colony; a tournament-based mechanism is employed in a colony to destruct/discard plants to evolve the colony toward a promising space; and a new reallocation operator is designed. The numerical results on two case studies are reported to positively showcase the feasibilities and merits of the proposed metaheuristic.
Vector Design Optimizations Using an Improved Cross-Entropy Method

Siguang An,Wei Wang,Shiyou Yang

DOI: https://doi.org/10.1109/tmag.2014.2357219

IF: 1.848

2015-01-01

IEEE Transactions on Magnetics

Abstract:An improved vector cross-entropy method is proposed to solve multi-objective design optimizations. To balance exploitation and exploration searches, the entire iterative process is recast into two phases: 1) diversification and 2) intensification phases. Different parameter updating mechanisms of the probability density function (pdf) are consequently designed. To enhance the diversity of the population, several different pdfs are evolved synchronously; to guarantee uniform distribution of the searched Pareto solutions, an elite projection mechanism is proposed. Mathematical functions and two inverse problems are used to testify the effectiveness and efficiency of the proposed method. The numerical results show that the proposed method can obtain well-distributed Pareto solutions using a small iteration number.
An Improved Regularity-Based Vector Evolutionary Algorithm for Multi-Objective Optimizations.

Yiying Li,Shiyou Yang

DOI: https://doi.org/10.1016/j.advengsoft.2022.103397

IF: 4.255

2023-01-01

Advances in Engineering Software

Abstract:Inverse models-based evolutionary algorithms can generate as many solutions as required in interest regions at a low budget cost. However, the objective value used for the inverse model in the original regularity-based al-gorithm using Gaussian process-based inverse models, (IM-MOEA), is linearly and separately sampled for each objective according to its maximum and minimum values so far searched. Consequently, some non-optimal even infeasible solutions may be sampled. Also, the number of the predefined reference vectors remains constant throughout the whole evolution. Consequently, it may result in a low computational efficiency for multi-objective optimization ones (MOOs) with nonuniform or disconnected Pareto fronts. In this respect, an improved regularity-based vector evolutionary algorithm for multi-objective optimizations is presented in the paper. The main component of the proposed algorithm is to obtain the training data for inverse models by interpolation in the objective space. The population is divided into subpopulations according to the number of objectives. The non-dominated solutions are utilized for interpolations in each subpopulation. The inverse models are finally used to generate offspring using data by interpolation. An adaptive interpolation range co-efficient is proposed for adaptive adjustments of the interpolation region to balance the exploitation and the exploration searches. An elite strategy of hiring elite individuals in the whole population to the current sub-population is employed to enhance the algorithm convergence. Experimental results on two test suites show the superiority of the proposed algorithm.
A Hybridized Vector Optimal Algorithm for Multiobjective Designs of Inverse Problems

Hu Guanzhong,Yang Shiyou,Li Yuling,Shafi Ullah Khan

2015-01-01

Abstract:Problem with multiple objectives is a natural fashion in most disciplines of the real world, and multi-objective evolutionary algorithm is a technique which has a challenge of achieving a series of best solutions with respect to fitness and spread. In this regard, it is essential to keep the balance of local and global search abilities. Quantum-behaved Particle Swarm Optimization (QPSO) is a population-based swarm intelligence algorithm, and Differential Evolutionary (DE) is another simple population based stochastic search method for global optimization with real valued parameters. Although the two techniques have been successfully employed to solve a wide range of problems, they also suffer from the premature convergence and the lack of diversity in the latter searching stages. This is probably due to the insufficient dimensional searching strength, especially for multi-objective optimization problems with many decision parameters. In this study, a new multi-objective non-dominated optimization methodology combining QPSO, DE and Tabu search algorithm (QPSO-DET) is proposed to guarantee the balance between the local and global searches. The performances of the proposed QPSO-DET are compared with those of other two widely recognized vector optimizers using different case studies.
A Real Coded Population-Based Incremental Learning for Inverse Problems in Continuous Space

Siu Lau Ho,Linhang Zhu,Shiyou Yang,Jin Huang

DOI: https://doi.org/10.1109/tmag.2014.2358628

IF: 1.848

2015-01-01

IEEE Transactions on Magnetics

Abstract:Evolutionary algorithms (EAs) have become the standards and paradigms for solving inverse problems. However, their two inherited operations, namely, the crossover and mutation operations, are complicated and difficult, both in theory and in numerical implementations. In this regard, increasing efforts have been devoted to EAs which are based on probabilistic models (EAPMs) to overcome the shortcomings of available EAs. The population-based incremental learning (PBIL) is an EAPM; moreover, it can bridge the gap between machine learning and the EAs, hence enjoying several merits compared with other EAs. However, lukewarm efforts have been devoted to PBILs, especially the real coded PBILs, in the study of inverse problems in electromagnetics. In this regard, a novel real coded PBIL is being proposed in this paper. In the proposed real coded PBIL, a probability matrix is proposed to randomly generate a population, and the updating formulas for this probability matrix using the so far searched best solution and the best solution of the current population are introduced to strike a balance between convergence performance and solution quality. The proposed real coded PBIL algorithm is numerically experimented on several case studies and promising results are reported in this paper.
An Improved Tabu-Based Vector Optimal Algorithm for Design Optimizations of Electromagnetic Devices

SY Yang,JR Cardoso,SL Ho,PH Ni,JM Machado,EWC Lo

DOI: https://doi.org/10.1109/tmag.2004.824798

IF: 1.848

2004-01-01

IEEE Transactions on Magnetics

Abstract:This paper introduces an improved tabu-based vector optimal algorithm for multiobjective optimal designs of electromagnetic devices. The improvements include a division of the entire search process, a new method for fitness assignment, a novel scheme for the generation and selection of neighborhood solutions, and so forth. Numerical results on a mathematical function and an engineering multiobjective design problem demonstrate that the proposed method can produce virtually the exact Pareto front, in both parameter and objective spaces, even though the iteration number used by it is only about 70% of that required by its ancestor.
An Improved Vector Evolutionary Algorithm For Multiobjective Designs Of Electromagnetic Devices

Man Nie,Shiyou Yang,Guangzheng Ni,Siulau Ho,Peihong Ni

DOI: https://doi.org/10.3233/JAE-2007-765

2007-01-01

International Journal of Applied Electromagnetics and Mechanics

Abstract:Thanks to the success in the design of a simple sharing function, the introduction of a novel fitness assignment strategy. and the development of a new local search procedure, this paper proposes an improved evolutionary algorithm for optimal problems involving several, often conflicting objectives. The simulation results on solving a mathematical function and a prototype problem reveal that the proposed method is effective in sampling the entire Pareto-optimal front and in distributing the generated solutions over the trade-off surface.
A Vector Wind Driven Optimization Algorithm For Multi-Objective Optimizations Of Electromagnetic Devices

Wenjia Yang,S. L. Ho,Shiyou Yang

DOI: https://doi.org/10.3233/JAE-171186

2019-01-01

International Journal of Applied Electromagnetics and Mechanics

Abstract:Wind driven optimization is a new entrant to evolutionary algorithms, and has been applied successfully to solve different engineering single objective (scalar) design problems. However, lukewarm efforts have been devoted to develop a vector optimizer using a wind driven optimization algorithm. This paper explores the potential of this new optimal method in solving multi-objective design problems in electromagnetics. In this regard, a vector wind driven optimization algorithm is proposed and validated using two inverse problems with promising numerical results.
A Hybridized Vector Optimal Algorithm for Multi-Objective Optimal Designs of Electromagnetic Devices

Guanzhong Hu,Shiyou Yang,Yuling Li,Shafi Ullah Khan

DOI: https://doi.org/10.1109/tmag.2015.2493181

IF: 1.848

2015-01-01

IEEE Transactions on Magnetics

Abstract:Multiple-objective designs exist in most real-world engineering problems in different disciplines. A multi-objective evolutionary algorithm will face a challenge to obtain a series of compromises of different objectives, called Pareto optimal solutions, and to distribute them uniformly. In this regard, it is essential to keep the balance of local and global search abilities of such algorithms. Quantum-behaved particle swarm optimization (QPSO) is a population-based swarm intelligence algorithm, and differential evolutionary (DE) is another simple population-based stochastic search one for global optimization with real-valued parameters. Although the two optimizers have been successfully employed to solve a wide range of design problems, they also suffer from premature convergence and insufficient diversity in the later searching stages. This is probably due to the insufficient dimensional searching strength, especially for problems with many decision parameters. In this paper, a new multi-objective non-dominated optimal methodology combining QPSO, DE, and tabu search algorithm (QPSO-DET) is proposed to guarantee the balance between the local and global searches. The performances of the proposed QPSO-DET are compared with those of other two widely recognized vector optimizers using different case studies.
A Quantum-Inspired Evolutionary Algorithm for Multi-Objective Design

S. L. Ho,Shiyou Yang,Peihong Ni,Jin Huang

DOI: https://doi.org/10.1109/tmag.2013.2238661

IF: 1.848

2013-01-01

IEEE Transactions on Magnetics

Abstract:To explore the full potential of Quantum-inspired Evolutionary Algorithms (QEA) in multiobjective design optimizations, a vector QEA is proposed. To fulfill the two ultimate goals of a vector optimizer in finding and uniformly sampling the Pareto front of a multiobjective inverse problem, a fitness assignment formula to consider the number of improvements in the whole objective functions and the amount of the improvement in a specified objective function, as well as the use of a selection mechanism in choosing the so far searched best solutions, are proposed in this paper. The information sharing and the increment angle updating components of the scalar QEA have also been redesigned according to the characteristics of multi-objective inverse problems. Numerical results on two case studies are presented to validate the proposed vector QEA.
AN IMPROVED GENETIC ALGORITHM FOR VECTOR OPTIMIZATION AND ITS APPLICATION TO DESIGN OPTIMIZATIONS OF ELECTROMAGNETIC DEVICES

王育槐,吴建华,杨仕友,倪光正

DOI: https://doi.org/10.3321/j.issn:0258-8013.2004.07.040

2004-01-01

Abstract:An improved evolutionary algorithm is proposed for the multi-objective design problems of electromagnetic devices. An emigration operator is designed to preserve the diversity and smooth the pareto front. The approaches such as the fitness sharing, the clustering method, and the elitism strategy are improved and extended. Two multi-objective optimal problems are solved using the proposed algorithm. The numerical results demonstrated that the proposed algorithm is a robust vector optimizer for engineering multi-objective design problems.
An Improved Multiple Single Objective Pareto Sampling Algorithm Applied to Many-Objective Inverse Problems

Liu Lei,An Siguang,Junwei Lu,Yang Shiyou

DOI: https://doi.org/10.3969/j.issn.1000-6753.2013.06.002

2013-01-01

Abstract:The optimal design (inverse) problems in electrical engineering are generally characterized as highly nonlinear mathematical programming ones. If more than one objectives are involved,a set of non-dominated solutions,rather than a single one,are required for decision making. The search of multiple solutions increases further the complexity of the problem. Although extensively and successfully applied in different engineering disciplines,the non-dominance based evolutionary algorithms will encounter difficulties in solving optimal problems with more than three objectives,termed many-objective optimization problems. To solve many-objective optimal problems,the multiple single objective pareto sampling (MSOPS and MSOPS-II) algorithm is proposed with exclusive features of simplicities of implementations and low computational complexities. However,it is observed that this algorithm is not satisfactory in views of convergence and diversity performances. In this regard,an improved MSOPS is proposed. In the proposed algorithm,a crowding operation of target vectors is incorporated to preserve the diversity of the solutions; a non-uniform target vector updating mechanism and an external archive are introduced to effectively explore the search space to speed up the convergence rate. The numerical results on the synthesis of a linear array and a Yagi-Uda array demonstrate the feasibility and merits of the proposed algorithm.

A Population-Based Incremental Learning Vector Algorithm for Multiobjective Optimal Designs

A Population-Based Incremental Learning Vector Algorithm For Multiobjective Optimal Designs

A Population-Based Incremental Learning Method for Robust Optimal Solutions

A Real Coded Vector Population-Based Incremental Learning Algorithm for Multi-Objective Optimizations of Electromagnetic Devices

A New Implementation of Population Based Incremental Learning Method for Optimizations in Electromagnetics

An Adaptive Real Coded Population-Based Incremental Learning Algorithm for Design Optimizations in Continuous Space

An Improved Population-Based Incremental Learning Method For Inverse Problems

A Tabu Based Vector Optimal Algorithm Applied to Multiobjective Designs of Electromagnetic Devices

A Computationally Efficient Vector Optimizer Using Ant Colony Optimizations Algorithm for Multobjective Designs

A Robust Metaheuristic Combining Clonal Colony Optimization and Population-Based Incremental Learning Methods

Vector Design Optimizations Using an Improved Cross-Entropy Method

An Improved Regularity-Based Vector Evolutionary Algorithm for Multi-Objective Optimizations.

A Hybridized Vector Optimal Algorithm for Multiobjective Designs of Inverse Problems

A Real Coded Population-Based Incremental Learning for Inverse Problems in Continuous Space

An Improved Tabu-Based Vector Optimal Algorithm for Design Optimizations of Electromagnetic Devices

An Improved Vector Evolutionary Algorithm For Multiobjective Designs Of Electromagnetic Devices

A Vector Wind Driven Optimization Algorithm For Multi-Objective Optimizations Of Electromagnetic Devices

A Hybridized Vector Optimal Algorithm for Multi-Objective Optimal Designs of Electromagnetic Devices

A Quantum-Inspired Evolutionary Algorithm for Multi-Objective Design

AN IMPROVED GENETIC ALGORITHM FOR VECTOR OPTIMIZATION AND ITS APPLICATION TO DESIGN OPTIMIZATIONS OF ELECTROMAGNETIC DEVICES

An Improved Multiple Single Objective Pareto Sampling Algorithm Applied to Many-Objective Inverse Problems