Abstract:Abstract Artificial neural networks (ANN) which include deep learning neural networks (DNN) have problems such as the local minimal problem of Back propagation neural network (BPNN), the unstable problem of Radial basis function neural network (RBFNN) and the limited maximum precision problem of Convolutional neural network (CNN). Performance (training speed, precision, etc.) of BPNN, RBFNN and CNN are expected to be improved. Main works are as follows: Firstly, based on existing BPNN and RBFNN, Wavelet neural network (WNN) is implemented in order to get better performance for further improving CNN. WNN adopts the network structure of BPNN in order to get faster training speed. WNN adopts the wavelet function as an activation function, whose form is similar to the radial basis function of RBFNN, in order to solve the local minimum problem. Secondly, WNN-based Convolutional wavelet neural network (CWNN) method is proposed, in which the fully connected layers (FCL) of CNN is replaced by WNN. Thirdly, comparative simulations based on MNIST and CIFAR-10 datasets among the discussed methods of BPNN, RBFNN, CNN and CWNN are implemented and analyzed. Fourthly, the wavelet-based Convolutional Neural Network (WCNN) is proposed, where the wavelet transformation is adopted as the activation function in Convolutional Pool Neural Network (CPNN) of CNN. Fifthly, simulations based on CWNN are implemented and analyzed on the MNIST dataset. Effects are as follows: Firstly, WNN can solve the problems of BPNN and RBFNN and have better performance. Secondly, the proposed CWNN can reduce the mean square error and the error rate of CNN, which means CWNN has better maximum precision than CNN. Thirdly, the proposed WCNN can reduce the mean square error and the error rate of CWNN, which means WCNN has better maximum precision than CWNN.

Incorporating Discrete Wavelet Transformation Decomposition Convolution into Deep Network to Achieve Light Training.

Learning a Wavelet-Like Auto-Encoder to Accelerate Deep Neural Networks

Multilevel Wavelet Decomposition Network for Interpretable Time Series Analysis

Surface Wave Suppression Through Deformable Convolutional Wavelet Transform Network with Residual Dense Blocks

Sparsing Deep Neural Network Using Semi-Discrete Matrix Decomposition

Decomposition and Composition of Deep Convolutional Neural Networks and Training Acceleration Via Sub-Network Transfer Learning

High speed deep networks based on Discrete Cosine Transformation

Wavelet-Based Dual-Task Network

Deep Adaptive Wavelet Network

Deep convolution neural network learning based on deconvolution feature extraction

An Efficient Hyperspectral Image Classification Method Using Deep Fusion of 3-D Discrete Wavelet Transform and CNN.

A Novel MapReduce-based Deep Convolutional Neural Network Algorithm.

WaveCNNs-AT: Wavelet-based deep CNNs of adaptive threshold for signal recognition

WaveSNet: Wavelet Integrated Deep Networks for Image Segmentation

Multi-stage image denoising with the wavelet transform

Efficient channel expansion and pyramid depthwise-pointwise-depthwise neural networks

Research on improved convolutional wavelet neural network

Deep Convolutional Network Based on Interleaved Fusion Group

PSDNet and DPDNet: Efficient Channel Expansion, Depthwise-Pointwise-Depthwise Inverted Bottleneck Block

A Lightweight Dynamic Dual-Damped Wavelet-Based Convolutional Neural Network for Interpretable Bearing Fault Diagnosis

Network Decoupling: From Regular to Depthwise Separable Convolutions