Abstract: Deep convolutional neural network (DCNN for short) models are vulnerable to examples with small perturbations. Adversarial training (AT for short) is a widely used approach to enhance the robustness of DCNN models by data augmentation. In AT, the DCNN models are trained with clean examples and adversarial examples (AE for short) which are generated using a specific attack method, aiming to gain ability to defend themselves when facing the unseen AEs. However, in practice, the trained DCNN models are often fooled by the AEs generated by the novel attack methods. This naturally raises a question: can a DCNN model learn certain features which are insensitive to small perturbations, and further defend itself no matter what attack methods are presented. To answer this question, this paper makes a beginning effort by proposing a shallow binary feature module (SBFM for short), which can be integrated into any popular backbone. The SBFM includes two types of layers, i.e., Sobel layer and threshold layer. In Sobel layer, there are four parallel feature maps which represent horizontal, vertical, and diagonal edge features, respectively. And in threshold layer, it turns the edge features learnt by Sobel layer to the binary features, which then are feeded into the fully connected layers for classification with the features learnt by the backbone. We integrate SBFM into VGG16 and ResNet34, respectively, and conduct experiments on multiple datasets. Experimental results demonstrate, under FGSM attack with $\epsilon=8/255$, the SBFM integrated models can achieve averagely 35\% higher accuracy than the original ones, and in CIFAR-10 and TinyImageNet datasets, the SBFM integrated models can achieve averagely 75\% classification accuracy. The work in this paper shows it is promising to enhance the robustness of DCNN models through feature learning.

FSDA: Frequency re-scaling in data augmentation for corruption-robust image classification

Dynamic Batch Norm Statistics Update for Natural Robustness

HybridAugment++: Unified Frequency Spectra Perturbations for Model Robustness

Pathological Myopia Image Recognition Strategy Based on Data Augmentation and Model Fusion

Improving the Robustness of Deep Convolutional Neural Networks Through Feature Learning

Frequency-Based Vulnerability Analysis of Deep Learning Models against Image Corruptions

A visualization method for data domain changes in CNN networks and the optimization method for selecting thresholds in classification tasks

Fourier-basis Functions to Bridge Augmentation Gap: Rethinking Frequency Augmentation in Image Classification

FFT-based Selection and Optimization of Statistics for Robust Recognition of Severely Corrupted Images

Sample-adaptive Augmentation for Point Cloud Recognition Against Real-world Corruptions

SF(DA)$^2$: Source-free Domain Adaptation Through the Lens of Data Augmentation

A Novel Data Augmentation Technique for Out-of-Distribution Sample Detection using Compounded Corruptions

SAPDA: Significant Areas Preserved Data Augmentation

Fourier-Based Frequency Space Disentanglement and Augmentation for Generalizable Face Anti-Spoofing

Self-transformation of Encoded Subregion Image Data Augmentation for Better Classification

Fourier-Based Augmentations for Improved Robustness and Uncertainty Calibration

Frequency Spectrum Augmentation Consistency for Domain Adaptive Object Detection

Frequency Consistent Adaptation for Real World Super Resolution

Jointly Resampling and Reconstructing Corrupted Images for Image Classification using Frequency-Selective Mesh-to-Grid Resampling

DFM-X: Augmentation by Leveraging Prior Knowledge of Shortcut Learning

BSDA: Bayesian Random Semantic Data Augmentation for Medical Image Classification