Abstract:Data augmentation has been an essential technique for improving the generalization ability of deep neural networks in image classification tasks. However, intensive changes in appearance and different degrees of occlusion in images are the key factors that severely affect the generalization ability of image classification models. Therefore, in order to enhance the generalization performance and robustness of deep models, data augmentation approaches by providing models with more diverse training data in various scenarios are widely applied. Although many existing data augmentation methods simulate occlusion in the augmented images to enhance the generalization of models, these methods randomly delete some areas in images without considering the semantic information of images. In this work, we propose a novel data augmentation method named AdvMask for image classification based on sparse adversarial attack techniques. AdvMask first identifies the key points that have the greatest influence on the classification results via a proposed end-to-end sparse adversarial attack module. During the data augmentation process, AdvMask efficiently generates diverse augmented data with structured occlusions based on the key points. By doing so, AdvMask can force deep models to seek other relevant content while the most discriminative content is hidden. Extensive experimental results on various benchmark datasets and deep models demonstrate that our proposed method can effectively improve the generalization performance of deep models and significantly outperforms previous data augmentation methods. Code for reproducing our results is available at https://github.com/Jackbrocp/AdvMask.

Image- and Instance-Level Data Augmentation for Occluded Instance Segmentation

Instance Segmentation under Occlusions via Location-aware Copy-Paste Data Augmentation

Augment Before Copy-Paste: Data and Memory Efficiency-Oriented Instance Segmentation Framework for Sport-scenes

Saliency information and mosaic based data augmentation method for densely occluded object recognition

A Sparse Attention Pipeline for DeepSportRadar Basketball Player Instance Segmentation Challenge

Strong Instance Segmentation Pipeline for MMSports Challenge

OccludedInst: an Efficient Instance Segmentation Network for Automatic Driving Occlusion Scenes

A Depth Information Aided Real-Time Instance Segmentation Method for Space Task Scenarios under CPU Platform

InstaBoost++: Visual Coherence Principles for Unified 2D/3D Instance Level Data Augmentation

Occluded Video Instance Segmentation: A Benchmark

Instance Segmentation Challenge Track Technical Report, VIPriors Workshop at ICCV 2021: Task-Specific Copy-Paste Data Augmentation Method for Instance Segmentation

Multi-Instance Object Segmentation With Occlusion Handling

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

In-and-Out: a data augmentation technique for computer vision tasks

Face recognition with a small occluded training set using spatial and statistical pooling.

Hybrid Task Cascade for Instance Segmentation

InstaBoost: Boosting Instance Segmentation Via Probability Map Guided Copy-Pasting

A comprehensive framework for occluded human pose estimation

Occluded Object Segmentation Based on Bilayer Decoupling Strategy and Attention Mechanism br

AdvMask: A Sparse Adversarial Attack Based Data Augmentation Method for Image Classification