Abstract:Data augmentation has been an essential technique for improving the generalization ability of deep neural networks in image classification tasks. However, intensive changes in appearance and different degrees of occlusion in images are the key factors that severely affect the generalization ability of image classification models. Therefore, in order to enhance the generalization performance and robustness of deep models, data augmentation approaches by providing models with more diverse training data in various scenarios are widely applied. Although many existing data augmentation methods simulate occlusion in the augmented images to enhance the generalization of models, these methods randomly delete some areas in images without considering the semantic information of images. In this work, we propose a novel data augmentation method named AdvMask for image classification based on sparse adversarial attack techniques. AdvMask first identifies the key points that have the greatest influence on the classification results via a proposed end-to-end sparse adversarial attack module. During the data augmentation process, AdvMask efficiently generates diverse augmented data with structured occlusions based on the key points. By doing so, AdvMask can force deep models to seek other relevant content while the most discriminative content is hidden. Extensive experimental results on various benchmark datasets and deep models demonstrate that our proposed method can effectively improve the generalization performance of deep models and significantly outperforms previous data augmentation methods. Code for reproducing our results is available at https://github.com/Jackbrocp/AdvMask.

DropMask: A data augmentation method for convolutional networks

Attentiondrop For Convolutional Neural Networks

MaskOut: A Data Augmentation Method for Masked Face Recognition.

DropConnect Regularization Method with Sparsity Constraint for Neural Networks

Active Dropblock: Method to Enhance Deep Model Accuracy and Robustness

TargetDrop: A Targeted Regularization Method for Convolutional Neural Networks

Data Dropout: Optimizing Training Data for Convolutional Neural Networks

BlockDrop: Dynamic Inference Paths in Residual Networks

Dynamic Training Data Dropout for Robust Deep Face Recognition

RANDOM MASK: Towards Robust Convolutional Neural Networks

GridMask Data Augmentation

FocusedDropout for Convolutional Neural Network

Beyond Dropout: Robust Convolutional Neural Networks Based on Local Feature Masking

AdvMask: A Sparse Adversarial Attack Based Data Augmentation Method for Image Classification

Enhancing Masked Time-Series Modeling via Dropping Patches

PointDrop: Improving Object Detection from Sparse Point Clouds Via Adversarial Data Augmentation

Mask-Guided Divergence Loss Improves the Generalization and Robustness of Deep Neural Network

An Effective Masked Transformer Network for Image Denoising

Gradient Mask: Lateral Inhibition Mechanism Improves Performance in Artificial Neural Networks

AutoDropout: Learning Dropout Patterns to Regularize Deep Networks

Locality-Aware Channel-Wise Dropout for Occluded Face Recognition