Abstract:The back propagation (BP) is one of the most widely used algorithms in the feedforward neural network (FNN), but selecting the non-optimal weights and thresholds may induce the slow convergence and local optimization. In this work, we propose an improved BP algorithm in which the loss function is constructed based on a small scale of data to seek the optimal weights and thresholds. The iteration process of the improved BP algorithm can be accelerated and the solutions will not be trapped into the local optimum. Solutions corresponding to the increasing scales of data are convergent which demonstrates the convergence of the parameters selection. Numerical simulations of elasticity and graphic reconstruction and repair confirm that the improved BP algorithm can achieve much faster convergence and higher efficiency than the conventional BP algorithm. Moreover, different initial values leading to the same optimal parameters indicates that the improved algorithm can achieve the global optimization during the learning process.

A Fast Learning Strategy For Multilayer Feedforward Neural Networks

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

Fast Learning Algorithms for Feedforward Neural Networks

A Fast Learning Algorithm for Feedfoward Neural Network Based on the Layer-by-Layer and Neuron-by-Neuron Optimizing Procedure

A Fast Learning Algorithm of Neural Networks by Changing Error Functions

A Fast Learning Algorithm Of Neural Network For The Training And Recognition Of The Phonemes

The Improvements of Bp Neural Network Learning Algorithm

Optimal Algorithm for a Multilayer Feedforward Net and Its Application

Multilayered Feed Forward Neural Network Based on Particle Swarm Optimizer Algorithm

Speeding Up the Training Process of the Mfnn by Optimizing the Hidden Layers' Outputs

A Fast Hybrid Algorithm Of Global Optimization For Feedforward Neural Networks

A New BP Algorithm with Adaptive Momentum for FNNs Training

A New Layer-Wise Linearized Algorithm for Feedforward Neural Network

An Algorithm for Fast Convergence of Back Propagation by Enlarging Error

A Modified Algorithm for Feedforward Neural Networks

A new fast learning algorithm for feedforward neural networks using U-D factorization-based extended Kalman Filter*

A Back-Propagation Algorithm with Adaptive Momentum Factor

A Fast Learning Algorithm of Feedforward Neural Networks by Using Novel Error Functions

Research of New Learning Method of Feedforward Neural Network

Optimal parameters selection of back propagation algorithm in the feedforward neural network

New Learning Algorithm for Feed-Forward Neural Network Based on Objective Back-Propagation