Abstract:Due to some correlative or repetitive factors between features or samples with high dimension and large amount of sample data, when traditional back-propagation (BP) neural network is used to solve this classification problem, it will present a series of problems such as network structural redundancy, low learning efficiency, occupation of storage space, consumption of computing time, and so on. All of these problems will restrict the operating efficiency and classification precision of neural network. To avoid them, partial least squares (PLS) algorithm is used to reduce the feature dimension of original data into low-dimensional data as the input of BP neural network, so that it can simplify the structure and accelerate convergence, thus improving the training speed and operating efficiency. In order to improve the classification precision of BP neural network by using hierarchical cluster analysis (HCA), similar samples are put into a sub-class, and some different sub-classes can be obtained. For each sub-class, a different training session can be conducted to find a corresponding precision BP neural network model, and the simulation samples of different sub-classes can be recognized by the corresponding network model. In this paper, the theories of PLS and HCA are combined together with the property of BP neural network, and an optimized classification algorithm by BP neural network based on PLS and HCA (PLS-HCA-BP algorithm) is proposed. The new algorithm is aimed at improving the operating efficiency and classification precision so as to provide a more reliable and more convenient tool for complex pattern classification systems. Three experiments and comparisons with four other algorithms are carried out to verify the superiority of the proposed algorithm, and the results indicate a good picture of the PLS-HCA-BP algorithm, which is worthy of further promotion.

Output representation of BP neural networks for classification problems

EEG Recognition Based on Multiple Types of Information by Using Wavelet Packet Transform and Neural Networks

Deep Neural Network Optimization Based on Binary Method for Handling Multi-Class Problems

Hyperbolic Binary Neural Network

A Comparison between the BP and RBF Networks

Binarizing by Classification: is Soft Function Really Necessary?

Brief Introduction of Back Propagation (BP) Neural Network Algorithm and Its Improvement

Optimization Study of BP Neural Network Based on Genetic Algorithm

A constrained optimization method based on BP neural network

A Rough Set Approach to BP Neural Network Designing

Research and Application on BP Neural Network Algorithm

Structured Binary Neural Networks for Accurate Image Classification and Semantic Segmentation.

BiPer: Binary Neural Networks using a Periodic Function

An optimized classification algorithm by BP neural network based on PLS and HCA

A Normalization Methods for Backpropagation: A Comparative Study

Probability Output of Multi-Class Support Vector Machines

Binary Higher Order Neural Networks for Realizing Boolean Functions.

Adjustable Bounded Rectifiers: Towards Deep Binary Representations

Do We Need Fully Connected Output Layers in Convolutional Networks?

Robust binary feedforword neural networks and their characteristics

Prototype-based interpretation of the functionality of neurons in winner-take-all neural networks