Abstract:Contemporary language models heavily rely on large corpora for their training. The larger the corpus, the better a model can capture various semantic relationships. The issue at hand appears to be the limited scope of the corpora used. One potential solution to this problem is the application of data augmentation techniques to expand the existing corpus. Data augmentation encompasses several techniques for corpus augmentation. In this article, we delve deeper into the analysis of three techniques: Synonym Replacement, Back Translation, and Reduction of Function Words. Utilizing these three techniques, we prepared diverse versions of the corpus employed for training Word2Vec Skip-gram models. These techniques were validated through extrinsic evaluation, wherein Word2Vec Skip-gram models were used to generate word vectors for classifying fake news articles. Performance measures of the generated classifiers were analyzed. The study highlights significant statistical differences in classifier outcomes between augmented and original corpora. Specifically, Back Translation significantly enhances accuracy, notably with Support Vector and Bernoulli Naive Bayes models. Conversely, the Reduction of Function Words (FWD) improves Logistic Regression, while the original corpus excels in Random Forest classification. The article also includes an intrinsic evaluation involving lexical semantic relations between word pairs. The intrinsic evaluation highlights nuanced differences in semantic relations across augmented corpora. Notably, the Back Translation (BT) corpus better aligns with established lexical resources, showcasing promising improvements in understanding specific semantic relationships.

Adverb Is the Key: Simple Text Data Augmentation with Adverb Deletion

Back-Modality: Leveraging Modal Transformation for Data Augmentation.

SoftEDA: Rethinking Rule-Based Data Augmentation with Soft Labels

Data Augmentation for Sentiment Classification with Semantic Preservation and Diversity

AutoAugment Is What You Need: Enhancing Rule-based Augmentation Methods in Low-resource Regimes

Text Data Augmentation for the Korean Language

Explainability-Based Mix-Up Approach for Text Data Augmentation

Adversarial Word Dilution as Text Data Augmentation in Low-Resource Regime

Reducing and Exploiting Data Augmentation Noise through Meta Reweighting Contrastive Learning for Text Classification

SDA: Simple Discrete Augmentation for Contrastive Sentence Representation Learning

Exploring Data Augmentation Methods on Social Media Corpora

DAGAM: Data Augmentation with Generation And Modification

Code-switching Sentence Generation by Generative Adversarial Networks and its Application to Data Augmentation

A Constraint-Enforcing Reward for Adversarial Attacks on Text Classifiers

Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification

On Evaluation Protocols for Data Augmentation in a Limited Data Scenario

EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks

Text Data Augmentation Techniques for Word Embeddings in Fake News Classification

Data augmentation in natural language processing: a novel text generation approach for long and short text classifiers

Enhancing Effectiveness and Robustness in a Low-Resource Regime via Decision-Boundary-aware Data Augmentation

Probabilistic Linguistic Knowledge and Token-level Text Augmentation