A Swarm Intelligence Based Artificial Neural Networks Learning Algorithm

Yunhui Yan

2008-01-01

Abstract:Swarm intelligence optimization is introduced into RBF(Radial Basic Function)neural networks training in this paper,a novel RBF neural networks learning algorithm based on particle swarm optimization is presented,and validated through numerical simulation.

What problem does this paper attempt to address?

Particle Swarm Optimization Based Rbf Neural Networks Learning Algorithm

Qi Kang,Jing An,Dongsheng Yang,Lei Wang,Qidi Wu

DOI: https://doi.org/10.1109/WCICA.2008.4592991

2008-01-01

Abstract:Swarm intelligence optimization is introduced into RBF neural networks training in this paper, a novel RBF neural networks learning algorithm based on particle swarm optimization is presented, and validated through numerical simulation. Finally, the unite framework of this RBF algorithm based on natural-inspired computation is proposed.
Research on RBF Neural Network Model Based on Particle Swarm Optimization

Yue Meng,Yuedong Zhang

DOI: https://doi.org/10.1109/ISAIEE57420.2022.00062

2022-12-01

Abstract:Intelligence for particle swarm optimization neural network algorithm. Based on the conventional PSO algorithm, the center of the basis function, the width of the basis function and the connection weight between the output layer and the hidden layer of the RBF neural network are optimized. The conclusion shows that the detection method studied in this paper has faster recognition speed and better recognition accuracy, and avoids the situation of falling into the local optimal solution.
Training Radial Basis Function Networks with Particle Swarms

Yu Liu,Qin Zheng,Zhewen Shi,Junying Chen

DOI: https://doi.org/10.1007/978-3-540-28647-9_54

2004-01-01

Abstract:In this paper, Particle Swarm Optimization (PSO) algorithm, a new promising evolutionary algorithm, is proposed to train Radial Basis Function (RBF) network related to automatic configuration of network architecture. Classification tasks on data sets: Iris, Wine, New-thyroid, and Glass are conducted to measure the performance of neural networks. Compared with a standard RBF training algorithm in Matlab neural network toolbox, PSO achieves more rational architecture for RBF networks. The resulting networks hence obtain strong generalization abilities.
Post-Partial Polynomial RBF Neural Network Algorithm Based on Particle Swarm Optimization

Yanyan WANG,Hongwei WANG

DOI: https://doi.org/10.3778/j.issn.1002-8331.1809-0273

2019-01-01

Abstract:RBF(Radial Basis Function)neural network can be well applied in various fields, the key lies in the selection of network model parameter weight, network center value, base width vector and implicit layer node number. The tradi-tional RBF neural network has the disadvantages of low accuracy, easy to fall into local optimal, slow convergence speed and so on. For these problems, the RBF neural network method is optimized by using particle swarm algorithm, that is, the weight value, network center value, and base width vector value of the RBF neural network containing the latter poly-nomial are optimized, and the optimal number of implicit nodes is selected. Then the PSOIRBF neural network is pro-posed. The effectiveness of the proposed algorithm is demonstrated by the simulation of nonlinear controlled objects such as nonlinear models and examples and the analysis of the models.
A hybrid particle swarm optimization and its application in neural networks

S. Y. S. Leung,Yang Tang,W. K. Wong

DOI: https://doi.org/10.1016/j.eswa.2011.07.028

IF: 8.5

2012-01-01

Expert Systems with Applications

Abstract:In this paper, a novel particle swarm optimization model for radial basis function neural networks (RBFNN) using hybrid algorithms to solve classification problems is proposed. In the model, linearly decreased inertia weight of each particle (ALPSO) can be automatically calculated according to fitness value. The proposed ALPSO algorithm was compared with various well-known PSO algorithms on benchmark test functions with and without rotation. Besides, a modified fisher ratio class separability measure (MFRCSM) was used to select the initial hidden centers of radial basis function neural networks, and then orthogonal least square algorithm (OLSA) combined with the proposed ALPSO was employed to further optimize the structure of the RBFNN including the weights and controlling parameters. The proposed optimization model integrating MFRCSM, OLSA and ALPSO (MOA-RBFNN) is validated by testing various benchmark classification problems. The experimental results show that the proposed optimization method outperforms the conventional methods and approaches proposed in recent literature.
Adaptive radial basis function neural network model based on discrete particle swarm optimization algorithms

Zhu Ke-jun

Abstract:A adaptive radial basis function(RBF) neural network model based on discrete particle swarm optimization(PSO) algorithms is proposed.The RBF network model can adaptively optimize hidden nodes,the center vector and the spread parameter of basis function via fusing two binary coded particles and improving the nearest-neighbor clustering center selection method.The model can also make the structure of the network be relatively simple(fewer hidden nodes) under the premise of the guarantee network performance.Furthermore,the gradient descent and recursion least squares are used to optimize the parameters of the basis function and the linear weight of the output layer,respectively.The simulation experiment proves the validity of the proposed model.

Computer Science
An Improved Particle Swarm Optimization Algorithm of Radial Basis Neural Network

Ji Weidong,Sun Liping,Wang Keqi,Lv Liguo,Li Yue

DOI: https://doi.org/10.14257/ijca.2016.9.10.38

2016-01-01

International Journal of Control and Automation

Abstract:The core issues of RBF network design are to design the minimum structure neural networks that can meet the accuracy requirements, in order to ensure the generalization ability of the network. For the purpose of simplifying the structure of RBF network, proposes a learning method of RBF network based on improved particle swarm. The method automatically constructs frugal structure of RBF network model by the combining algorithm of regularized least squares method and Doptimal experimental design; chooses three learning parameters of the combining algorithm that can affect network generalization performance by the improved particle swarm optimization algorithm. By nonlinear time series modeling, verifies the effectiveness of the method in this paper.
Swarm Intelligence Optimization Algorithms and Their Application

Ting Yu,Limin Wang,Xuming Han,Ying Liu,Li Zhang

2015-01-01

Abstract:Swarm intelligence optimization algorithm is an emerging technology tosimulate the evolution of the law of nature and acts of biological communities, it has simple and robust characteristics. The algorithm has been successfully applied in many fields. This paper summarizes the research status of swarm intelligence optimization algorithm and application progress. Elaborate the basic principle of ant colony algorithm and particle swarm algorithm. Carry out a detailed analysis of drosophila algorithm and firefly algorithm developed in recent years, and put forward deficiencies of each algorithm and direction for improvement.
An Integrated Hybrid Algorithm Based On Nature Inspired Evolutionary For Radial Basis Function Neural Network Learning

z y chen,r j kuo,t l hu

DOI: https://doi.org/10.1142/S0218213016500044

IF: 1.1

2016-01-01

International Journal on Artificial Intelligence Tools

Abstract:This paper intends to propose an integrated hybrid algorithm for training radial basis function neural network (RBFNN) learning. The proposed integrated of particle swarm and genetic algorithm based optimization (IPGO) algorithm is composed of two approaches based on particle swarm optimization (PSO) and genetic algorithm (GA) for gathering both their virtues to improve the learning performance of RBFNN. The diversity of individuals results in higher chance to search in the direction of global optimal instead of being confined to local optimal particularly in problem with higher complexity. The IPGO algorithm with PSO-based and GA-based approaches has shown promising results in some benchmark problems with three continuous test functions. After proposing the algorithm for these problems with result providing its outperforming performance, this paper supplements a practical application case for the papaya milk sales forecasting to expound the superiority of the IPGO algorithm. In addition, model evaluation results of the case have showed that the IPGO algorithm outperforms other algorithms and auto-regressive moving average (ARMA) models in terms of forecasting accuracy and execution time.
A Novel Radial Basis Function Neural Network Method Based on Improved Particle Swarm Optimization

ZHAO Min

DOI: https://doi.org/10.3969/j.issn.1006-9348.2009.12.034

2009-01-01

Abstract:To prevent the problem that structure and parameters of neural network are hard to be tuned,a novel radial basis function(RBF) neural network method based on improved particle swarm optimization(IMPSO) is proposed. In the proposed method,firstly,Nearest neighbor cluster algorithm is utilized to RBF neural network,secondly, an improved particle swarm optimization(PSO) which synthesizes the existing models of PSO,Half of the poor fitness particles are updated by the other half to good fitness particles and the particles focus on the optimum space. Cluster distance factor is searched by the improved PSO for radial basis function(RBF) neural network,and units in RBF layer is determined.The new training algorithm is used to approximate polynominal function and predict chaotic time series,compared with PSO,and CFA PSO,the algorithm improves the velocity of convergence,and has much higher accuracy.
Locating the Parameters of RBF Networks Using a Hybrid Particle Swarm Optimization Method

Ioannis G. Tsoulos,Vasileios Charilogis

DOI: https://doi.org/10.3390/a16020071

2023-01-22

Algorithms

Abstract:In the present work, an innovative two-phase method is presented for parameter tuning in radial basis function artificial neural networks. These kinds of machine learning models find application in many scientific fields in classification problems or in function regression. In the first phase, a technique based on particle swarm optimization is performed to locate a promising interval of values for the network parameters. Particle swarm optimization was used as it is a highly reliable method for global optimization problems, and in addition, it is one of the fastest and most-flexible techniques of its class. In the second phase, the network was trained within the optimal interval using a global optimization technique such as a genetic algorithm. Furthermore, in order to speed up the training of the network and due to the use of a two-stage method, parallel programming techniques were utilized. The new method was applied to a number of famous classification and regression datasets, and the results were more than promising.
Intelligent Optimization Strategy for ELM-RBF Neural Networks

LI Bin,LI Yi-bin,RONG Xue-wen

2010-01-01

Abstract:A method of intelligent optimization strategy for extreme learning machine-radial basis function (ELM-RBF) neural networks was proposed,in which the centers and impact widths of hidden neural kernels were determined by the intelligent optimization algorithms of differential evolution and particle swarm optimization.Simulation results showed that the ELM-RBF neural networks learning algorithm based on the intelligent optimization strategy could generate much better generalization performance and robustness than other algorithms with the same network architecture.
RBF design method based on center clustering and PSO

LIU Jun,SHANG Xiu-qin,LU Jian-gang,CHEN Jin-shui,SUN You-xian

DOI: https://doi.org/10.3778/j.issn.1002-8331.2009.36.060

2009-01-01

Abstract:An algorithm for designing Radial Basis Function Neural Network based on center clustering and modified particle swarm optimization algorithm is introduced.Center clustering algorithm is proposed to process the input sample,and adaptively specify the hidden layer parameters of RBF neural network;classic PSO algorithm(Particle Swarm Optimization) with modified calculation method about globally optimal solution is used to train the parameters,and makes them tend to global optima;the output layer weights are updated on line by recursive least square algorithm with forgetting factor.At last,the hybrid algorithm is applied to design the prediction model about relationship between the sinter composition and drum strength.Then experiment validates the model with new data which are collected from sinter workshop.Experimental results show that the hybrid algorithm has high convergence speed,and model built by that has great prediction precision.
Polynomial-based Radial Basis Function Neural Networks (P-RBF NNs) Realized with the Aid of Particle Swarm Optimization

Sung-Kwun Oh,Wook-Dong Kim,Witold Pedrycz,Byoung-Jun Park

DOI: https://doi.org/10.1016/j.fss.2010.08.007

IF: 4.462

2011-01-01

Fuzzy Sets and Systems

Abstract:In this study, we design polynomial-based radial basis function neural networks (P-RBF NNs) based on a fuzzy inference mechanism. The essential design parameters (including learning rate, momentum coefficient and fuzzification coefficient of the underlying clustering method) are optimized by means of the particle swarm optimization. The proposed P-RBF NNs dwell upon structural findings about training data that are expressed in terms of a partition matrix resulting from fuzzy clustering in this case being the fuzzy C-means (FCM). The network is of functional nature as the weights between the hidden layer and the output are some polynomials. The use of the polynomial weights becomes essential in capturing the nonlinear nature of data encountered in regression or classification problems. From the perspective of linguistic interpretation, the proposed network can be expressed as a collection of “if–then” fuzzy rules. The architecture of the networks discussed here embraces three functional modules reflecting the three phases of input–output mapping realized in rule-based architectures, namely condition formation, conclusion creation, and aggregation. The proposed classifier is applied to some synthetic and machine learning datasets, and its results are compared with those reported in the previous studies.
Multi-swarm particle swarm optimization based on autonomic learning and elite swarm

Hai-yan JIANG,Fang-fang WANG,Xiao-qing GUO,Jia-xiang ZHUANG

DOI: https://doi.org/10.13195/j.kzyjc.2013.1034

2014-01-01

Abstract:In order to promote the particles’ autonomic learning ability in the dynamic multi-swarm particle swarm optimization algorithm, a multi-swarm particle swarm optimization algorithm based on autonomic learning and elite swarm is proposed. According to the concept of autonomic learning , the algorithm can achieve the purpose of optimization through replacing the regrouping operation with choosing learning objects autonomously in base swarms and conducting local searches in elite swarms. The proposed algorithm is applied to six text functions and compared with the dynamic multi-swarm particle swarm optimization algorithm. The results show that the proposed algorithm has a good performance in the convergence speed, the search accuracy, the time consumption and so on.
A novel adaptive algorithm of particle swarm optimization based on the human social learning intelligence

Jialu Liu,Zhong Wan,Jiyue E

DOI: https://doi.org/10.1016/j.swevo.2023.101336

IF: 10.267

2023-05-19

Swarm and Evolutionary Computation

Abstract:A novel adaptive algorithm of particle swarm optimization is proposed in this paper, where the learning strategy is designed by simulating features of human social learning intelligence. By the principles of this strategy, the swarm is first adaptively grouped into a number of subswarms based on the fitness levels of particles, as well as no need of fixing the population sizes as done in the existing algorithms. Then, the particles in each subswarm constitute three different types classified by their evolutionary levels, which adopt different learning modes defined by distinct adaptive inertia weighting rules and dynamical learning mechanisms. Consequently, all the particles play their respective roles in promoting the global optimization performance of our algorithm, just like all the individuals in society. Numerical tests of our algorithm are conducted by solution of the standard benchmark test problems from the CEC 2014 and CEC 2017 test suites. The test results show the advantages of the proposed learning strategy in this paper, and demonstrate that the overall performance of our algorithm outperforms both of the other compared PSO variants and the other state-of-the-art evolutionary algorithms, in terms of global search ability, solution accuracy and convergence speed. Statistical tests also validate the promising performance of our algorithm.

computer science, artificial intelligence, theory & methods
Training RBF neural network with hybrid particle swarm optimization

Haichang Gao,Boqin Feng,Yun Hou,Li Zhu

DOI: https://doi.org/10.1007/11759966_86

2006-01-01

Abstract:The particle swarm optimization (PSO) has been used to train neural networks. But the particles collapse so quickly that it exits a potentially dangerous stagnation characteristic, which would make it impossible to arrive at the global optimum. In this paper, a hybrid PSO with simulated annealing and Chaos search technique (HPSO) is adopted to solve this problem. The HPSO is proposed to train radial basis function (RBF) neural network. Benchmark function optimization and dataset classification problems (Iris, Glass, Wine and New-thyroid) experimental results demonstrate the effectiveness and efficiency of the proposed algorithm.
Adaptive modelling with tunable RBF network using multi-innovation RLS algorithm assisted by swarm intelligence

Hao Chen,Yu Gong,Xia Hong

DOI: https://doi.org/10.1109/ICASSP.2011.5946748

2011-01-01

ICASSP

Abstract:In this paper, we propose a new on-line learning algorithm for the non-linear system identification: the swarm intelligence aided multi-innovation recursive least squares (SI-MRLS) algorithm. The SI-MRLS algorithm applies the particle swarm optimization (PSO) to construct a flexible radial basis function (RBF) model so that both the model structure and output weights can be adapted. By replacing an insignificant RBF node with a new one based on the increment of error variance criterion at every iteration, the model remains at a limited size. The multi-innovation RLS algorithm is used to update the RBF output weights which are known to have better accuracy than the classic RLS. The proposed method can produces a parsimonious model with good performance. Simulation result are also shown to verify the SI-MRLS algorithm.
Neural Network Training Algorithm Based on Particle Swarm Optimization

Hong-bo LIU,Xiu-kun WANG,Jun MENG

DOI: https://doi.org/10.3969/j.issn.1000-1220.2005.04.019

2005-01-01

Abstract:A training algorithm for neural network based on particle swarm optimization was investigated. There are some comparison between genetic algorithm and particle swarm optimization algorithm in our experiences. The results show that the training algorithm based on PSO is a good one with strong competitiveness.
Evolving RBF neural networks for pattern classification

Zheng Qin,Junying Chen,Yu Liu,Jiang Lu

DOI: https://doi.org/10.1007/11596448_142

2005-01-01

Abstract:When a radial-basis function neural network (RBFNN) is used for pattern classification, the problem involves designing the topology of RBFNN and also its centers and widths. In this paper, we present a particle swarm optimization (PSO) learning algorithm to automate the design of RBF networks, to solve pattern classification problems. Simulation results for benchmark problems in the pattern classification area show that the PSO-RBF outperforms two other learning algorithms in terms of network size and generalization performance.

A Swarm Intelligence Based Artificial Neural Networks Learning Algorithm

Particle Swarm Optimization Based Rbf Neural Networks Learning Algorithm

Research on RBF Neural Network Model Based on Particle Swarm Optimization

Training Radial Basis Function Networks with Particle Swarms

Post-Partial Polynomial RBF Neural Network Algorithm Based on Particle Swarm Optimization

A hybrid particle swarm optimization and its application in neural networks

Adaptive radial basis function neural network model based on discrete particle swarm optimization algorithms

An Improved Particle Swarm Optimization Algorithm of Radial Basis Neural Network

Swarm Intelligence Optimization Algorithms and Their Application

An Integrated Hybrid Algorithm Based On Nature Inspired Evolutionary For Radial Basis Function Neural Network Learning

A Novel Radial Basis Function Neural Network Method Based on Improved Particle Swarm Optimization

Locating the Parameters of RBF Networks Using a Hybrid Particle Swarm Optimization Method

Intelligent Optimization Strategy for ELM-RBF Neural Networks

RBF design method based on center clustering and PSO

Polynomial-based Radial Basis Function Neural Networks (P-RBF NNs) Realized with the Aid of Particle Swarm Optimization

Multi-swarm particle swarm optimization based on autonomic learning and elite swarm

A novel adaptive algorithm of particle swarm optimization based on the human social learning intelligence

Training RBF neural network with hybrid particle swarm optimization

Adaptive modelling with tunable RBF network using multi-innovation RLS algorithm assisted by swarm intelligence

Neural Network Training Algorithm Based on Particle Swarm Optimization

Evolving RBF neural networks for pattern classification