Abstract:Data augmentation is a dominant method for reducing model overfitting and improving generalization. Most existing data augmentation methods tend to find a compromise in augmenting the data, \textit{i.e.}, increasing the amplitude of augmentation carefully to avoid degrading some data too much and doing harm to the model performance. We delve into the relationship between data augmentation and model performance, revealing that the performance drop with heavy augmentation comes from the presence of out-of-distribution (OOD) data. Nonetheless, as the same data transformation has different effects for different training samples, even for heavy augmentation, there remains part of in-distribution data which is beneficial to model training. Based on the observation, we propose a novel data augmentation method, named \textbf{DualAug}, to keep the augmentation in distribution as much as possible at a reasonable time and computational cost. We design a data mixing strategy to fuse augmented data from both the basic- and the heavy-augmentation branches. Extensive experiments on supervised image classification benchmarks show that DualAug improve various automated data augmentation method. Moreover, the experiments on semi-supervised learning and contrastive self-supervised learning demonstrate that our DualAug can also improve related method. Code is available at \href{<a class="link-external link-https" href="https://github.com/shuguang99/DualAug" rel="external noopener nofollow">this https URL</a>}{<a class="link-external link-https" href="https://github.com/shuguang99/DualAug" rel="external noopener nofollow">this https URL</a>}.

BO-Aug: Learning Data Augmentation Policies Via Bayesian Optimization

Learning Optimal Data Augmentation Policies via Bayesian Optimization for Image Classification Tasks

Learning Data Augmentation Policies Using Augmented Random Search.

Bayesian Optimization Based on Pseudo Labels

Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules

A Good Data Augmentation Policy Is Not All You Need: A Multi-Task Learning Perspective

Automatic Data Augmentation by Learning the Deterministic Policy

AutoAugment: Learning Augmentation Policies from Data

Deep AutoAugment

A Unified Search Framework for Data Augmentation and Neural Architecture on Small-scale Image Datasets

DualAug: Exploiting Additional Heavy Augmentation with OOD Data Rejection

EventAugment: Learning Augmentation Policies from Asynchronous Event-based Data

Augmented Bayesian Policy Search

A Survey of Automated Data Augmentation Algorithms for Deep Learning-based Image Classification Tasks

Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification

LatentAugment: Dynamically Optimized Latent Probabilities of Data Augmentation

Greedy Policy Search: A Simple Baseline for Learnable Test-Time Augmentation

MetaAugment: Sample-Aware Data Augmentation Policy Learning

MixBoost: Improving the Robustness of Deep Neural Networks by Boosting Data Augmentation

Local Patch AutoAugment with Multi-Agent Collaboration

Enabling Data Diversity: Efficient Automatic Augmentation via Regularized Adversarial Training