Abstract:Though widely used in image classification, convolutional neural networks (CNNs) are prone to noise interruptions, i.e. the CNN output can be drastically changed by small image noise. To improve the noise robustness, we try to integrate CNNs with wavelet by replacing the common down-sampling (max-pooling, strided-convolution, and average pooling) with discrete wavelet transform (DWT). We firstly propose general DWT and inverse DWT (IDWT) layers applicable to various orthogonal and biorthogonal discrete wavelets like Haar, Daubechies, and Cohen, etc., and then design wavelet integrated CNNs (WaveCNets) by integrating DWT into the commonly used CNNs (VGG, ResNets, and DenseNet). During the down-sampling, WaveCNets apply DWT to decompose the feature maps into the low-frequency and high-frequency components. Containing the main information including the basic object structures, the low-frequency component is transmitted into the following layers to generate robust high-level features. The high-frequency components are dropped to remove most of the data noises. The experimental results show that WaveCNets achieve higher accuracy on ImageNet than various vanilla CNNs. We have also tested the performance of WaveCNets on the noisy version of ImageNet, ImageNet-C and six adversarial attacks, the results suggest that the proposed DWT/IDWT layers could provide better noise-robustness and adversarial robustness. When applying WaveCNets as backbones, the performance of object detectors (i.e., faster R-CNN and RetinaNet) on COCO detection dataset are consistently improved. We believe that suppression of aliasing effect, i.e. separation of low frequency and high frequency information, is the main advantages of our approach. The code of our DWT/IDWT layer and different WaveCNets are available at https://github.com/CVI-SZU/WaveCNet.

A Noise-Robust Algorithm for Classifying Cyclic and Dihedral Symmetric Images

A New Algorithm To Detect Edge For Infrared Image Based On Two-Dimension Continuous Wavelet Transform

Robust watermarking detection against RST based on principal axis

A Robust Deblurring Algorithm for Noisy Images with Just Noticeable Blur

Robust Symmetry Detection via Riemannian Langevin Dynamics

An Image Watermarking Algorithm with High Robustness

A Semi-Fragile Blind Watermarking Scheme For Color Images Based On Visual Cryptography And Discrete Cosine Transform

Towards more reasonable identifications of the symmetries in noisy digital images from periodic and aperiodic crystals

Robust Image Hashing for Image Authentication Based on DCT-DWT Composite Domain

WaveCNet: Wavelet Integrated CNNs to Suppress Aliasing Effect for Noise-Robust Image Classification

Efficient Rotation- and Scale-Invariant Texture Classification Method Based on Gabor Wavelets

A New Noise Removing Algorithm

Self-Clustering Symmetry Detection.

OBJECT REPRESENTATION AND SYMMETRY DETECTION BASED ON IMPLICIT POLYNOMIAL CURVES

An adaptive hybrid pattern for noise-robust texture analysis

Rotation Invariant Texture Classification Based on Gabor Wavelets

A Noise-Robust Partial Blur Detection Algorithm Combining Walsh Transform and Sequency Truncation

Robust Watermarking Algorithm Based on Classification and Selection Mechanism

Analysis on Image Symmetry Detection Algorithms

A Noise-Robust Adaptive Hybrid Pattern for Texture Classification

A Robust Zero-Watermarking Algorithm for Medical Images Using Curvelet-Dct and RSA Pseudo-random Sequences.