Abstract:Abstract Artificial neural networks (ANN) which include deep learning neural networks (DNN) have problems such as the local minimal problem of Back propagation neural network (BPNN), the unstable problem of Radial basis function neural network (RBFNN) and the limited maximum precision problem of Convolutional neural network (CNN). Performance (training speed, precision, etc.) of BPNN, RBFNN and CNN are expected to be improved. Main works are as follows: Firstly, based on existing BPNN and RBFNN, Wavelet neural network (WNN) is implemented in order to get better performance for further improving CNN. WNN adopts the network structure of BPNN in order to get faster training speed. WNN adopts the wavelet function as an activation function, whose form is similar to the radial basis function of RBFNN, in order to solve the local minimum problem. Secondly, WNN-based Convolutional wavelet neural network (CWNN) method is proposed, in which the fully connected layers (FCL) of CNN is replaced by WNN. Thirdly, comparative simulations based on MNIST and CIFAR-10 datasets among the discussed methods of BPNN, RBFNN, CNN and CWNN are implemented and analyzed. Fourthly, the wavelet-based Convolutional Neural Network (WCNN) is proposed, where the wavelet transformation is adopted as the activation function in Convolutional Pool Neural Network (CPNN) of CNN. Fifthly, simulations based on CWNN are implemented and analyzed on the MNIST dataset. Effects are as follows: Firstly, WNN can solve the problems of BPNN and RBFNN and have better performance. Secondly, the proposed CWNN can reduce the mean square error and the error rate of CNN, which means CWNN has better maximum precision than CNN. Thirdly, the proposed WCNN can reduce the mean square error and the error rate of CWNN, which means WCNN has better maximum precision than CWNN.

generalized approach of convolutional and pooling layer in image processing using wavelet CNN

Continuous Volumetric Convolution Network with Self-Learning Kernels for Point Clouds

Wavelet Convolutional Neural Networks

Advances in Convolutional Neural Networks

Image Classification Using Convolutional Neural Network with Wavelet Domain Inputs

Exploring Novel Pooling Strategies for Edge Preserved Feature Maps in Convolutional Neural Networks

Texture and Materials Image Classification Based on Wavelet Pooling Layer in CNN

Matched Wavelet Pooling for Efficient Light-Weight CNN Network Architectures with Application to Image Classification

Wavelet Convolutional Neural Networks for Texture Classification

Evaluating the Potential of Wavelet Pooling on Improving the Data Efficiency of Light-Weight CNNs

Less Is More: Matched Wavelet Pooling-Based Light-Weight CNNs With Application to Image Classification

CNN Denoising for Medical Image Based on Wavelet Domain

Research on improved convolutional wavelet neural network

Research on improved wavelet convolutional wavelet neural networks

Non-linear Convolution Filters for CNN-based Learning

Wasserstein Pooling for Image Classification

Wavelet Integrated CNNs for Noise-Robust Image Classification

A Structurally Regularized Convolutional Neural Network for Image Classification using Wavelet-based SubBand Decomposition

Cascade wavelet transform based convolutional neural networks with application to image classification

Pooling in convolutional neural networks for medical image analysis: a survey and an empirical study

Wavelet Feature Maps Compression for Image-to-Image CNNs