Abstract:Data augmentation has been proved to be a critical and effective way to alleviate over-fitting of deep learning model. Region-level removal is one of state-of-the-art solutions, which can not only synthesize vicinity samples, but also improve generalization of model. However, region removing using random strategy tends to make the training samples suffer from excessive information loss and the introduction of negative noise. In this paper, we propose a novel data augmentation scheme called Self-Replacement-and-Keeping-Augment (SRK-Augment), which exploits self-deformation data as the replacement template and keeps discriminative parts guided by Class Activation Map (CAM) in input image. Concretely, we firstly exploit Grad-CAM++ algorithm to calculate the CAM mask of the input image, and design a patch-shuffling mechanism ( PS-operator ) to obtain the structural self-deformation template. Then, we utilize the self-deformation template to fill the information removal area, as well as we apply the binary CAM mask to recover the discriminative regions. Finally, these augmented data will be randomly used for model training. The proposed method is simple to implement and can be incorporated with existing augmentation strategies with low computational cost. Extensive experiments are conducted on the challenging datasets. With the help of the SRK-Augment strategy, the performances of DCNNs have achieved obvious improvements. On CIFAR-10 dataset, the Top-1 error rate is dropped by 2.07% at most; On CIFAR-100 dataset, the Top-1 error rate is decreased by up to 3.73%; On Mini-ImageNet dataset, the maximum decline of the Top-1 error rate is 3.38%; On Pascal VOC dataset, the mean Average Precision increases by a maximum of 1.38%. Experimental results manifest the effectiveness and generality of the proposed method.

Random Blur Data Augmentation for Scene Text Recognition

Difficulty-Aware Data Augmentor for Scene Text Recognition

Sample-aware Data Augmentor for Scene Text Recognition

Application of Random Region Augmentation Algorithm in Deep Learning

Maskstr: Guide Scene Text Recognition Models with Masking

Learn to Augment: Joint Data Augmentation and Network Optimization for Text Recognition

Data Augmentation Using Mixup and Random Erasing

Random Erasing Data Augmentation.

SRK-Augment: A Self-Replacement and Discriminative Region Keeping Augmentation Scheme for Better Classification.

Illumination-Based Data Augmentation for Robust Background Subtraction

TextSSR: Diffusion-based Data Synthesis for Scene Text Recognition

Robust Scene Text Recognition with Automatic Rectification

RPN: A Word Vector Level Data Augmentation Algorithm in Deep Learning for Language Understanding

Data Augmentation for Low-Level Vision: CutBlur and Mixture-of-Augmentation

Accurate Scene Text Detection Via Scale-Aware Data Augmentation and Shape Similarity Constraint

Exploring Data Augmentations on Self-/Semi-/Fully- Supervised Pre-trained Models

Deep reinforcement learning enables adaptive-image augmentation for automated optical inspection of plant rust

A Simple Background Augmentation Method for Object Detection with Diffusion Model

Data Augmentation in Classification and Segmentation: A Survey and New Strategies

Enhancing Effectiveness and Robustness in a Low-Resource Regime via Decision-Boundary-aware Data Augmentation

Decoder Pre-Training with only Text for Scene Text Recognition