Abstract:When the initial weights and thresholds of back-propagation network are optimized by genetic algorithm,the learning process is more likely trapped into flat spot which results in slow or even suppressed learning process and weight adjustment due to the large scope of weight-initializing in genetic algorithm.To solve this problem and inspired by the research fruits of neuroscience and physiological anatomy,an improved learning algorithm based on weight adjustment parameters is proposed.It avoids premature saturation problem that the weight adjustment reaching zero by introducing an excitation unit into the neuron model to excitation the back-propagated error signal.Simulation results show that the new method can avoid the learning process being trapped into the flat spot efficiently and improve the capability of fine-tuning to the result optimized by the genetic algorithm.The new algorithm also outperforms the other traditional methods in terms of the convergence rate,stability,and the capability of searching optimum in large space.

New Learning Algorithm for Feed-Forward Neural Network Based on Objective Back-Propagation

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

Research of New Learning Method of Feedforward Neural Network

Fast Learning Algorithms for Feedforward Neural Networks

An Algorithm for Fast Convergence of Back Propagation by Enlarging Error

Brief Introduction of Back Propagation (BP) Neural Network Algorithm and Its Improvement

A Fast Learning Algorithm for Feedfoward Neural Network Based on the Layer-by-Layer and Neuron-by-Neuron Optimizing Procedure

A Fast Learning Algorithm of Neural Networks by Changing Error Functions

Optimal Algorithm for a Multilayer Feedforward Net and Its Application

A New Global Optimization Algorithm for Training Feedforward Neural Networks and Its Application

Optimal parameters selection of back propagation algorithm in the feedforward neural network

Training Feed-forward Neural Networks Using the Gradient Descent Method with the Optimal Stepsize

Solving Flat-Spot Problem in Back-Propagation Learning Algorithm Based on Magnified Error

Research on Back-Propagation Learning Algorithm Based on Weight Adjustment Parameters

BP algorithm based on network complexity

A Fast Learning Algorithm Of Neural Network For The Training And Recognition Of The Phonemes

An Effective Backpropagation Algorithm for Optimizing BP Neural Network Based on Rough Set and Modified Genetic Algorithm

The Improved Rapid Convergence Algorithm of the Connecting Rights in the BP Network

New and Rapidly Converging BP Neural Network Algorithm

Multilayered Feed Forward Neural Network Based on Particle Swarm Optimizer Algorithm

A Fast Learning Algorithm of Feedforward Neural Networks by Using Novel Error Functions