Abstract:A back propagation neural network based on selective attention (SABP) is proposed for improving the learning speed of multi-layer artificial neural networks with sigmoid activation function. The algorithm embedded the selective attention model in the NN training. The key to this algorithm lies in the pre-attention function, in which primitive features of the stimulus were detected in parallel by what might be called feature detectors by an improved GA, and the attention function, in which detail features were handled with the attention spotlight by the BP with an enlarged error item in the output layer. Therefore, the SABP obtained the ability of searching the global optimum solution relying on the pre-attention function that made a lower fault rate to drop into local optimum, and the attention function updated the weights of neural network effectively by enlarging the error in the output layer, which kept a high leaning rate to meet the convergence criteria quickly. The simulation experiments demonstrate that the algorithm is more powerful than Momentum algorithm or Delta-bar-Delta rule in learning, and it can effectively avoid failure training caused by randomizing the initial weights and thresholds, and solve the slow convergence problem resulting from the Flat-Spots when the error signal becomes too small.

A Fast Learning Algorithm Of Neural Network For The Training And Recognition Of The Phonemes

Fast Learning Algorithms for Feedforward Neural Networks

A Fast Hybrid Algorithm Of Global Optimization For Feedforward Neural Networks

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

Fast learning algorithms for time-delay neural networks phoneme recognition

A Fast Learning Algorithm for Time-Delay Neural Networks

A Fast Learning Strategy For Multilayer Feedforward Neural Networks

A Fast Learning Algorithm of Neural Networks by Changing Error Functions

A Fast Learning Algorithm for Feedfoward Neural Network Based on the Layer-by-Layer and Neuron-by-Neuron Optimizing Procedure

Feedback control standpoint based fast training approach of neural networks and its application

An Improved Back-Propagation Algorithm Applied To Target Recognition

Back Propagation Based on Selective Attention for Fast Convergence of Training Neural Network

Speaker-independent speech recognition based on a fast NN algorithm

An Algorithm for Fast Convergence of Back Propagation by Enlarging Error

Training Feed-forward Neural Networks Using the Gradient Descent Method with the Optimal Stepsize

Alternating update layers for DBN-DNN fast training method

The Improvements of Bp Neural Network Learning Algorithm

Research on Multi - Base Depth Neural Network Speech Recognition

A New Algorithm for Fast Discriminative Training

Nonlinear stretching for enhanced learning of the backpropagation algorithm in target recognition

Speeding Up the Training Process of the Mfnn by Optimizing the Hidden Layers' Outputs