Abstract:Large models, encompassing large language and diffusion models, have shown exceptional promise in approximating human-level intelligence, garnering significant interest from both academic and industrial spheres. However, the training of these large models necessitates vast quantities of high-quality data, and with continuous updates to these models, the existing reservoir of high-quality data may soon be depleted. This challenge has catalyzed a surge in research focused on data augmentation methods. Leveraging large models, these data augmentation techniques have outperformed traditional approaches. This paper offers an exhaustive review of large model-driven data augmentation methods, adopting a comprehensive perspective. We begin by establishing a classification of relevant studies into three main categories: image augmentation, text augmentation, and paired data augmentation. Following this, we delve into various data post-processing techniques pertinent to large model-based data augmentation. Our discussion then expands to encompass the array of applications for these data augmentation methods within natural language processing, computer vision, and audio signal processing. We proceed to evaluate the successes and limitations of large model-based data augmentation across different scenarios. Concluding our review, we highlight prospective challenges and avenues for future exploration in the field of data augmentation. Our objective is to furnish researchers with critical insights, ultimately contributing to the advancement of more sophisticated large models. We consistently maintain the related open-source materials at: https://github.com/MLGroup-JLU/LLM-data-aug-survey.

Data Augmentation with Large Language Models for Vietnamese Abstractive Text Summarization

VieSum: How Robust Are Transformer-based Models on Vietnamese Summarization?

Overview of the VLSP 2022 -- Abmusu Shared Task: A Data Challenge for Vietnamese Abstractive Multi-document Summarization

BERT-VBD: Vietnamese Multi-Document Summarization Framework

Towards Comprehensive Vietnamese Retrieval-Augmented Generation and Large Language Models

Text Summarization Using Large Language Models: A Comparative Study of MPT-7b-instruct, Falcon-7b-instruct, and OpenAI Chat-GPT Models

ExtraPhrase: Efficient Data Augmentation for Abstractive Summarization

Scaling Up Video Summarization Pretraining with Large Language Models

Mitigating Data Scarcity for Large Language Models

Efficient Adaptation of Pretrained Transformers for Abstractive Summarization

Discrete Diffusion Language Model for Long Text Summarization

Multisumm: Towards A Unified Model For Multi-Lingual Abstractive Summarization

ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation

Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challenges

A Survey on Data Augmentation in Large Model Era

SA-HAVE: A Self-Attention based Hierarchical VAEs Network for Abstractive Summarization

Evaluating Large Language Model Capability in Vietnamese Fact-Checking Data Generation

AugSumm: towards generalizable speech summarization using synthetic labels from large language model

Summarization-based Data Augmentation for Document Classification

Large, Small or Both: A Novel Data Augmentation Framework Based on Language Models for Debiasing Opinion Summarization