Abstract:Data augmentation has shown its effectiveness in resolving the data-hungry problem and improving model's generalization ability. However, the quality of augmented data can be varied, especially compared with the raw/original data. To boost deep learning models' performance given augmented data/samples in text classification tasks, we propose a novel framework, which leverages both meta learning and contrastive learning techniques as parts of our design for reweighting the augmented samples and refining their feature representations based on their quality. As part of the framework, we propose novel weight-dependent enqueue and dequeue algorithms to utilize augmented samples' weight/quality information effectively. Through experiments, we show that our framework can reasonably cooperate with existing deep learning models (e.g., RoBERTa-base and Text-CNN) and augmentation techniques (e.g., Wordnet and Easydata) for specific supervised learning tasks. Experiment results show that our framework achieves an average of 1.6%, up to 4.3% absolute improvement on Text-CNN encoders and an average of 1.4%, up to 4.4% absolute improvement on RoBERTa-base encoders on seven GLUE benchmark datasets compared with the best baseline. We present an indepth analysis of our framework design, revealing the non-trivial contributions of our network components. Our code is publicly available for better reproducibility.

AUG-BERT: An Efficient Data Augmentation Algorithm for Text Classification

Conditional BERT Contextual Augmentation

AugGPT: Leveraging ChatGPT for Text Data Augmentation

Data Augmentation Methods for Enhancing Robustness in Text Classification Tasks

DAGAM: Data Augmentation with Generation And Modification

Data augmentation in natural language processing: a novel text generation approach for long and short text classifiers

Enhanced Offensive Language Detection Through Data Augmentation

What Have Been Learned & What Should Be Learned? An Empirical Study of How to Selectively Augment Text for Classification

STA: Self-controlled Text Augmentation for Improving Text Classifications

On Data Augmentation for Extreme Multi-label Classification

Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation

Improving Text Classification with Large Language Model-Based Data Augmentation

Exploring Data Augmentation Methods on Social Media Corpora

Exploring ChatGPT-based Augmentation Strategies for Contrastive Aspect-based Sentiment Analysis

Data augmentation strategies to improve text classification: a use case in smart cities

Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification

Not Enough Data? Deep Learning to the Rescue!

Enhancing Black-Box Few-Shot Text Classification with Prompt-Based Data Augmentation

Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification

Data Augmentation With Semantic Enrichment for Deep Learning Invoice Text Classification

SDA: Improving Text Generation with Self Data Augmentation