Abstract:Data augmentation has been proved to be a critical and effective way to alleviate over-fitting of deep learning model. Region-level removal is one of state-of-the-art solutions, which can not only synthesize vicinity samples, but also improve generalization of model. However, region removing using random strategy tends to make the training samples suffer from excessive information loss and the introduction of negative noise. In this paper, we propose a novel data augmentation scheme called Self-Replacement-and-Keeping-Augment (SRK-Augment), which exploits self-deformation data as the replacement template and keeps discriminative parts guided by Class Activation Map (CAM) in input image. Concretely, we firstly exploit Grad-CAM++ algorithm to calculate the CAM mask of the input image, and design a patch-shuffling mechanism ( PS-operator ) to obtain the structural self-deformation template. Then, we utilize the self-deformation template to fill the information removal area, as well as we apply the binary CAM mask to recover the discriminative regions. Finally, these augmented data will be randomly used for model training. The proposed method is simple to implement and can be incorporated with existing augmentation strategies with low computational cost. Extensive experiments are conducted on the challenging datasets. With the help of the SRK-Augment strategy, the performances of DCNNs have achieved obvious improvements. On CIFAR-10 dataset, the Top-1 error rate is dropped by 2.07% at most; On CIFAR-100 dataset, the Top-1 error rate is decreased by up to 3.73%; On Mini-ImageNet dataset, the maximum decline of the Top-1 error rate is 3.38%; On Pascal VOC dataset, the mean Average Precision increases by a maximum of 1.38%. Experimental results manifest the effectiveness and generality of the proposed method.

Grid self-occlusion: a grid self-occlusion data augmentation for better classification

GridMask Data Augmentation

Saliency information and mosaic based data augmentation method for densely occluded object recognition

SRK-Augment: A Self-Replacement and Discriminative Region Keeping Augmentation Scheme for Better Classification.

In-and-Out: a data augmentation technique for computer vision tasks

Random Erasing Data Augmentation.

AdvMask: A Sparse Adversarial Attack Based Data Augmentation Method for Image Classification

Interpretability-Mask: a Label-Preserving Data Augmentation Scheme for Better Classification

Data Augmentation Using Mixup and Random Erasing

ROBYOL: Random-Occlusion-Based BYOL for Hyperspectral Image Classification

Image Ordinal Classification and Understanding: Grid Dropout with Masking Label

See Better Before Looking Closer: Weakly Supervised Data Augmentation Network for Fine-Grained Visual Classification

Grid Loss: Detecting Occluded Faces

FenceMask: A Data Augmentation Approach for Pre-extracted Image Features

Exploring Data Augmentations on Self-/Semi-/Fully- Supervised Pre-trained Models

An Over-Regression Suppression Method to Discriminate Occluded Objects of Same Category

Unlocking the Potential of Data Augmentation in Contrastive Learning for Hyperspectral Image Classification

A visualization method for data domain changes in CNN networks and the optimization method for selecting thresholds in classification tasks

Grid-augumented vision: A simple yet effective approach for enhanced spatial understanding in multi-modal agents

MaskCOV: A random mask covariance network for ultra-fine-grained visual categorization

Circular Shift: an Effective Data Augmentation Method for Convolutional Neural Network on Image Classification.