Abstract:Genetic algorithms (GA) has been extensively applied to address the shortcomings of gradient based leaning methods in training feedforward neural networks (NN). However, the complicated properties of NN training, such as context dependence problem between neurons and permutation problem of genetic representation, will cause difficulties in efficiently implementing conventional GAs. In the present study, a novel hybrid GA design is proposed to overcome these problems. First, for the sake of eliminating the context dependence, the new method adopts GA and least squares estimator to separately optimize the neurons in hidden and output layers. Second, in order to completely avoid the permutation problem, the proposed GA design employs two heterogeneous populations that evolve in company but respectively learn the optimal combinations and parameters of hidden neuron. Finally, experimental studies encouragingly show that, in comparison with five well-known conventional approaches, the new training method displays a much better approximation and generalization capabilities in nonlinear static and dynamic modeling, especially for the observed signals corrupted with large measurement noises.

An Improved Genetic Algorithm for Training Layered Feedforward Neural Networks

Optimizing Feed-Forward Neural Networks Using Cascaded Genetic Algorithm

A Hybrid Genetic Algorithm for Designing Feedforward Neural Networks

The Evolving Artificial Neural Network Based on Genetic Algorithm

Heterogeneous Double Populations Based Hybrid Genetic Algorithm Design For Training Feedforward Neural Networks

Network Training and Architecture Optimization by a Recursive Approach and a Modified Genetic Algorithm

Improved Fuzzy-Tuned Neural Network and Its Application

Design of Feedforward Neural Network Based on Immune Genetic Algorithm

Genetic algorithms and artificial neural network. (1) Training artificial neural network with extended genetic algorithms

Neural Network Optimization Based on Improved Diploidic Genetic Algorithm

Improving fault-tolerance of feedforward neural networks with genetic algorithms

Structural Optimization of Feedforward Neural Network Based on Genetic Algorithms

Optimal feed-forward neural networks based on the combination of constructing and pruning by genetic algorithms

Multilayer feed-forward neural networks based on immune genetic algorithm

The Application of One Improved Niche Genetic Algorithm for Elman Recurrent Neural Networks

Genetic Algorithm Based on New Evaluation Function and Mutation Model for Training of BPNN

A New Improved Genetic Algorithm to Obtain Solutions Quickly

An Improved Genetic Algorithm and Its Performance Analysis

A GA Aided Training Method for Function-Link Neural Network

Neural Network Model for Genetic Algorithm

Optimizing Multi-Instance Neural Networks Based on an Improved Genetic Algorithm