Abstract:Data-hungry deep neural networks have established themselves as the standard for many NLP tasks including the traditional sequence tagging ones. Despite their state-of-the-art performance on high-resource languages, they still fall behind of their statistical counter-parts in low-resource scenarios. One methodology to counter attack this problem is text augmentation, i.e., generating new synthetic training data points from existing data. Although NLP has recently witnessed a load of textual augmentation techniques, the field still lacks a systematic performance analysis on a diverse set of languages and sequence tagging tasks. To fill this gap, we investigate three categories of text augmentation methodologies which perform changes on the syntax (e.g., cropping sub-sentences), token (e.g., random word insertion) and character (e.g., character swapping) levels. We systematically compare them on part-of-speech tagging, dependency parsing and semantic role labeling for a diverse set of language families using various models including the architectures that rely on pretrained multilingual contextualized language models such as mBERT. Augmentation most significantly improves dependency parsing, followed by part-of-speech tagging and semantic role labeling. We find the experimented techniques to be effective on morphologically rich languages in general rather than analytic languages such as Vietnamese. Our results suggest that the augmentation techniques can further improve over strong baselines based on mBERT. We identify the character-level methods as the most consistent performers, while synonym replacement and syntactic augmenters provide inconsistent improvements. Finally, we discuss that the results most heavily depend on the task, language pair, and the model type.

Data Augmentation on Problem and Method Sentence Classification Task in Scientific Paper: A Mechanism Analysis Study.

Exploring Data Augmentation Methods on Social Media Corpora

Data Augmentation Techniques for Process Extraction from Scientific Publications

An Empirical Survey of Data Augmentation for Limited Data Learning in NLP

Data Augmentation Revisited: Rethinking the Distribution Gap between Clean and Augmented Data

A Comprehensive Survey on Data Augmentation

A Survey on Data Augmentation in Large Model Era

What Have Been Learned & What Should Be Learned? An Empirical Study of How to Selectively Augment Text for Classification

A Survey of Data Augmentation Approaches for NLP

To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLP

Data augmentation in natural language processing: a novel text generation approach for long and short text classifiers

DAGAM: Data Augmentation with Generation And Modification

An Analysis of Simple Data Augmentation for Named Entity Recognition

On Evaluation Protocols for Data Augmentation in a Limited Data Scenario

Data Augmentation For Deep Learning Of Judgment Documents

Evaluating the Impact of Data Augmentation on Predictive Model Performance

The effectiveness of data augmentation in code readability classification

Task-driven Augmented Data Evaluation

Semantic-Based Data Augmentation for Math Word Problems

SDA: Improving Text Generation with Self Data Augmentation