Abstract:Abstract Artificial neural networks (ANN) which include deep learning neural networks (DNN) have problems such as the local minimal problem of Back propagation neural network (BPNN), the unstable problem of Radial basis function neural network (RBFNN) and the limited maximum precision problem of Convolutional neural network (CNN). Performance (training speed, precision, etc.) of BPNN, RBFNN and CNN are expected to be improved. Main works are as follows: Firstly, based on existing BPNN and RBFNN, Wavelet neural network (WNN) is implemented in order to get better performance for further improving CNN. WNN adopts the network structure of BPNN in order to get faster training speed. WNN adopts the wavelet function as an activation function, whose form is similar to the radial basis function of RBFNN, in order to solve the local minimum problem. Secondly, WNN-based Convolutional wavelet neural network (CWNN) method is proposed, in which the fully connected layers (FCL) of CNN is replaced by WNN. Thirdly, comparative simulations based on MNIST and CIFAR-10 datasets among the discussed methods of BPNN, RBFNN, CNN and CWNN are implemented and analyzed. Fourthly, the wavelet-based Convolutional Neural Network (WCNN) is proposed, where the wavelet transformation is adopted as the activation function in Convolutional Pool Neural Network (CPNN) of CNN. Fifthly, simulations based on CWNN are implemented and analyzed on the MNIST dataset. Effects are as follows: Firstly, WNN can solve the problems of BPNN and RBFNN and have better performance. Secondly, the proposed CWNN can reduce the mean square error and the error rate of CNN, which means CWNN has better maximum precision than CNN. Thirdly, the proposed WCNN can reduce the mean square error and the error rate of CWNN, which means WCNN has better maximum precision than CWNN.

Optimization method for hidden layer nodes of WNN based on rough set reduction

Ant Algorithm Based Optimization Of Neural Network Model Of Water Distribution System

Novel Algorithm of Wavelet Network Structural Design

Optimal Method of Neuro-Fuzzy Network and Its Application Based on Variable Precision Rough Set

Optimization of a Multilayer Neural Network by Using Minimal Redundancy Maximal Relevance-Partial Mutual Information Clustering with Least Square Regression

Model of Information Security Risk Assessment Based on Improved Wavelet Neural Network.

System partitioning on MCM using a new neural network model

Efficiency optimization methods for stochastic configuration networks

Optimizing Radial Basis Function Neural Network Based on Rough Sets and Affinity Propagation Clustering Algorithm

Research on improved convolutional wavelet neural network

An Optimization Algorithm on the Number of Hidden Layer Nodes in Feed-forward Neural Network

Optimization of RBF neural networks using a rough K-means Algorithm and application to naphtha dry point soft sensors

Fault Diagnosis for Wireless Sensor Network's Node Based on Hamming Neural Network and Rough Set

Optimization of hidden nodes and training times in artificial neural network

An Optimization Method for the Topological Structures of Feed-Forward Multi-Layer Neural Networks

Tuning Of The Structure And Parmeters Of Wavelet Neural Network Using Improved Chaotic Pso

Research upon multistage optimal control by wavelet neural network

Research on improved wavelet convolutional wavelet neural networks

Fault Diagnosis of Node in WSN Based on Integration of Rough Sets and Neural Network

RCBNN:A New Constructing Method for Neural Network

Tuning of the Structure and Parameters of Wavelet Neural Network Using Improved Chaotic PSO