Abstract:Data augmentation has been proved to be a critical and effective way to alleviate over-fitting of deep learning model. Region-level removal is one of state-of-the-art solutions, which can not only synthesize vicinity samples, but also improve generalization of model. However, region removing using random strategy tends to make the training samples suffer from excessive information loss and the introduction of negative noise. In this paper, we propose a novel data augmentation scheme called Self-Replacement-and-Keeping-Augment (SRK-Augment), which exploits self-deformation data as the replacement template and keeps discriminative parts guided by Class Activation Map (CAM) in input image. Concretely, we firstly exploit Grad-CAM++ algorithm to calculate the CAM mask of the input image, and design a patch-shuffling mechanism ( PS-operator ) to obtain the structural self-deformation template. Then, we utilize the self-deformation template to fill the information removal area, as well as we apply the binary CAM mask to recover the discriminative regions. Finally, these augmented data will be randomly used for model training. The proposed method is simple to implement and can be incorporated with existing augmentation strategies with low computational cost. Extensive experiments are conducted on the challenging datasets. With the help of the SRK-Augment strategy, the performances of DCNNs have achieved obvious improvements. On CIFAR-10 dataset, the Top-1 error rate is dropped by 2.07% at most; On CIFAR-100 dataset, the Top-1 error rate is decreased by up to 3.73%; On Mini-ImageNet dataset, the maximum decline of the Top-1 error rate is 3.38%; On Pascal VOC dataset, the mean Average Precision increases by a maximum of 1.38%. Experimental results manifest the effectiveness and generality of the proposed method.

DDA: A Dynamic Difficulty-aware Data Augmenter for Image Super-resolution

Enhanced Data Augmentation for Denoising and Super-Resolution Reconstruction of Radiation Images

DAW-GAN: a generative adversarial network based on the dynamic adaptive weight for image super-resolution

SamplingAug: on the Importance of Patch Sampling Augmentation for Single Image Super-Resolution.

DifAugGAN: A Practical Diffusion-style Data Augmentation for GAN-based Single Image Super-resolution

DDet: Dual-path Dynamic Enhancement Network for Real-World Image Super-Resolution

Rethinking Data Augmentation for Image Super-resolution: A Comprehensive Analysis and a New Strategy

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

AdaDiffSR: Adaptive Region-aware Dynamic Acceleration Diffusion Model for Real-World Image Super-Resolution

SRK-Augment: A Self-Replacement and Discriminative Region Keeping Augmentation Scheme for Better Classification.

DDistill-SR: Reparameterized Dynamic Distillation Network for Lightweight Image Super-Resolution

AdaAugment: A Tuning-Free and Adaptive Approach to Enhance Data Augmentation

A Data Enhancement Method toward Real-World Single Image Super-Resolution

Adaptive Semantic-Enhanced Denoising Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution

EntAugment: Entropy-Driven Adaptive Data Augmentation Framework for Image Classification

DADA: Differentiable Automatic Data Augmentation

Difficulty-Aware Data Augmentor for Scene Text Recognition

DeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable Diffusion

Data-Efficient Augmentation for Training Neural Networks

Universal Adaptive Data Augmentation