Abstract:Data augmentation is essential to achieve state-of-the-art performance in many deep learning applications. However, the most effective augmentation techniques become computationally prohibitive for even medium-sized datasets. To address this, we propose a rigorous technique to select subsets of data points that when augmented, closely capture the training dynamics of full data augmentation. We first show that data augmentation, modeled as additive perturbations, improves learning and generalization by relatively enlarging and perturbing the smaller singular values of the network Jacobian, while preserving its prominent directions. This prevents overfitting and enhances learning the harder to learn information. Then, we propose a framework to iteratively extract small subsets of training data that when augmented, closely capture the alignment of the fully augmented Jacobian with labels/residuals. We prove that stochastic gradient descent applied to the augmented subsets found by our approach has similar training dynamics to that of fully augmented data. Our experiments demonstrate that our method achieves 6.3x speedup on CIFAR10 and 2.2x speedup on SVHN, and outperforms the baselines by up to 10% across various subset sizes. Similarly, on TinyImageNet and ImageNet, our method beats the baselines by up to 8%, while achieving up to 3.3x speedup across various subset sizes. Finally, training on and augmenting 50% subsets using our method on a version of CIFAR10 corrupted with label noise even outperforms using the full dataset. Our code is available at: <a class="link-external link-https" href="https://github.com/tianyu139/data-efficient-augmentation" rel="external noopener nofollow">this https URL</a>

MeshCut data augmentation for deep learning in computer vision

Boosting Unsupervised Contrastive Learning Using Diffusion-Based Data Augmentation from Scratch

In-and-Out: a data augmentation technique for computer vision tasks

Enhancing Performance of Deep Learning Models with a Novel Data Augmentation Approach

AdvMask: A Sparse Adversarial Attack Based Data Augmentation Method for Image Classification

GridMask Data Augmentation

FenceMask: A Data Augmentation Approach for Pre-extracted Image Features

A Data Augmentation Method Based on Multi-Modal Image Fusion for Detection and Segmentation

Exploring Data Augmentations on Self-/Semi-/Fully- Supervised Pre-trained Models

Image data augmentation techniques based on deep learning: A survey

Data Augmentation in Classification and Segmentation: A Survey and New Strategies

Data-Efficient Augmentation for Training Neural Networks

Image Data Augmentation for Deep Learning: A Survey

An Augmentation Strategy for Medical Image Processing Based on Statistical Shape Model and 3D Thin Plate Spline for Deep Learning

Improving Deep Learning using Generic Data Augmentation

Data augmentation for deep visual recognition using superpixel based pairwise image fusion

MixCut:A Data Augmentation Method for Facial Expression Recognition

Saliency information and mosaic based data augmentation method for densely occluded object recognition

WeMix: How to Better Utilize Data Augmentation

TextAug: Test time Text Augmentation for Multimodal Person Re-identification

A survey on Image Data Augmentation for Deep Learning