Abstract:Three common numerical optimization algorithms are first studied, including conjugate gradient algorithm, quasi-newton algorithm and LM algorithm. The three kinds of algorithms are used to improve BP neural network respectively and the corresponding classification models based on BP neural network are established. Then the models are used in pattern classification of two-dimensional vectors, and their generalization abilities are also tested. The classification results of different classification models based on BP network are compared with each other. Simulation results show that for small or medium scale networks, BP neural network improved by LM algorithm has the most precise classification result, the fastest convergence speed and the best classification ability. The one improved by conjugate gradient algorithm has the biggest error, slowest convergence speed and worst classification ability. While the classification precision, convergence speed and classification ability of quasi-newton algorithm lie between the above two algorithms.

The Performance Comparison of Several Kinds of Modified BP Algorithm

Improved BP algorithm for neural network and its application in welding process control

An Improved BP Algorithm Based on Parallel

Comparative Study on Fast Learning Algorithms of BP Networks

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Comparative of Pattern Classification of BP Neural Networks Improved by Numerical Optimization Approach

Implementation and Comparison of Improving BP Neural Network Based on MATLAB

BP algorithm based on network complexity

An Improved Model of BP Neural Network Algorithm

An Imporved Algorithm of BP Neural Network and Its Application

BP Neural Network Algorithm Improvements and Convergence Analysis

On Improved Algorithm of LMBP Neural Networks

An Improved Back-propagation NN Algorithm And Its Application

Comparison of BP Algorithms in Matlab NN Toolbox

Research and Application of BP Algorithm Based on Genetic Algorithm in System Performance Bottleneck Analysis

Study on the Improved BP Algorithm and Application

Study on BP Algorithm of Single Parameter Quick Search and Its Application

Study of the Optimized Algorithms of BP Neural Network

Approximation Performance of Bp Neural Networks Improved by Heuristic Approach

New and Rapidly Converging BP Neural Network Algorithm

An Effective Backpropagation Algorithm for Optimizing BP Neural Network Based on Rough Set and Modified Genetic Algorithm