Abstract:Large models, encompassing large language and diffusion models, have shown exceptional promise in approximating human-level intelligence, garnering significant interest from both academic and industrial spheres. However, the training of these large models necessitates vast quantities of high-quality data, and with continuous updates to these models, the existing reservoir of high-quality data may soon be depleted. This challenge has catalyzed a surge in research focused on data augmentation methods. Leveraging large models, these data augmentation techniques have outperformed traditional approaches. This paper offers an exhaustive review of large model-driven data augmentation methods, adopting a comprehensive perspective. We begin by establishing a classification of relevant studies into three main categories: image augmentation, text augmentation, and paired data augmentation. Following this, we delve into various data post-processing techniques pertinent to large model-based data augmentation. Our discussion then expands to encompass the array of applications for these data augmentation methods within natural language processing, computer vision, and audio signal processing. We proceed to evaluate the successes and limitations of large model-based data augmentation across different scenarios. Concluding our review, we highlight prospective challenges and avenues for future exploration in the field of data augmentation. Our objective is to furnish researchers with critical insights, ultimately contributing to the advancement of more sophisticated large models. We consistently maintain the related open-source materials at:

Data Augmentation by Program Transformation

Source Code Data Augmentation for Deep Learning: A Survey

The effectiveness of data augmentation in code readability classification

Data Augmentation for Code Translation with Comparable Corpora and Multiple References

A Survey on Data Augmentation in Large Model Era

GenCode: A Generic Data Augmentation Framework for Boosting Deep Learning-Based Code Understanding

Exploring Empty Spaces: Human-in-the-Loop Data Augmentation

Towards Controlled Data Augmentations for Active Learning.

A Comprehensive Survey on Data Augmentation

Exploring Data Augmentation Methods on Social Media Corpora

A Survey of Data Augmentation Approaches for NLP

On the Generalization Effects of Linear Transformations in Data Augmentation

Text Data Augmentation for Deep Learning

Effective Data Augmentation With Diffusion Models

Enhanced Transfer Learning with Data Augmentation

Data Augmentation for Sentiment Classification with Semantic Preservation and Diversity

AutoAugment Is What You Need: Enhancing Rule-based Augmentation Methods in Low-resource Regimes

Data Augmentation using Generative-AI

Tied-Augment: Controlling Representation Similarity Improves Data Augmentation