Abstract:Data augmentation is essential to achieve state-of-the-art performance in many deep learning applications. However, the most effective augmentation techniques become computationally prohibitive for even medium-sized datasets. To address this, we propose a rigorous technique to select subsets of data points that when augmented, closely capture the training dynamics of full data augmentation. We first show that data augmentation, modeled as additive perturbations, improves learning and generalization by relatively enlarging and perturbing the smaller singular values of the network Jacobian, while preserving its prominent directions. This prevents overfitting and enhances learning the harder to learn information. Then, we propose a framework to iteratively extract small subsets of training data that when augmented, closely capture the alignment of the fully augmented Jacobian with labels/residuals. We prove that stochastic gradient descent applied to the augmented subsets found by our approach has similar training dynamics to that of fully augmented data. Our experiments demonstrate that our method achieves 6.3x speedup on CIFAR10 and 2.2x speedup on SVHN, and outperforms the baselines by up to 10% across various subset sizes. Similarly, on TinyImageNet and ImageNet, our method beats the baselines by up to 8%, while achieving up to 3.3x speedup across various subset sizes. Finally, training on and augmenting 50% subsets using our method on a version of CIFAR10 corrupted with label noise even outperforms using the full dataset. Our code is available at: <a class="link-external link-https" href="https://github.com/tianyu139/data-efficient-augmentation" rel="external noopener nofollow">this https URL</a>

NeighborMix Data Augmentation for Image Recognition

Data Augmentation Using Mixup and Random Erasing

ResizeMix: Mixing Data with Preserved Object Information and True Labels

LGCOAMix: Local and Global Context-and-Object-Part-Aware Superpixel-Based Data Augmentation for Deep Visual Recognition

DiffuseMix: Label-Preserving Data Augmentation with Diffusion Models

MixAugment & Mixup: Augmentation Methods for Facial Expression Recognition

GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing

RandoMix: a mixed sample data augmentation method with multiple mixed modes

PatchMix: patch-level mixup for data augmentation in convolutional neural networks

WeMix: How to Better Utilize Data Augmentation

ColMix -- A Simple Data Augmentation Framework to Improve Object Detector Performance and Robustness in Aerial Images

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty

A New Data Augmentation Method Based on Mixup and Dempster-Shafer Theory

Attribute Mix: Semantic Data Augmentation for Fine Grained Recognition

MixGen: A New Multi-Modal Data Augmentation

MiAMix: Enhancing Image Classification through a Multi-stage Augmented Mixed Sample Data Augmentation Method

TransformMix: Learning Transformation and Mixing Strategies from Data

LMix: Regularization Strategy for Convolutional Neural Networks.

MixCut:A Data Augmentation Method for Facial Expression Recognition

Data-Efficient Augmentation for Training Neural Networks

LMix:Regularization Strategy for Convolutional Neural Networks