Abstract:Data augmentation is an effective method for the performance enhancement of neural machine translation (NMT) by generating additional bilingual data. In this article, we propose a novel data augmentation strategy for neural machine translation. Unlike existing data augmentation methods that simply modify words with the same probability across different sentences, we introduce a sentence-specific probability approach for word selection based on the syntactic roles of words in the sentence. Our motivation is to consider a linguistics-motivated method to obtain more ingenious language generation rather than relying on computation-motivated approaches only. We argue that high-quality aligned bilingual data is crucial for NMT, and only computation-motivated data augmentation is insufficient to provide good enough extra enhancement data. Our approach leverages dependency parse trees of input sentences to determine the selection probability of each word in the sentence using three different functions to calculate probabilities for words with different depths. Besides, our method also revises the probability for words considering the sentence length. We evaluate our methods on multiple translation tasks. The experimental results demonstrate that our proposed data augmentation method does effectively boost existing sentence-independent methods for significant improvement of performance on translation tasks. Furthermore, an ablation study shows that our method does select fewer essential words and preserves the syntactic structure.

Improved statistical machine translation using monolingual paraphrases

Enriching SMT Training Data Via Paraphrasing.

A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages

Translating from Morphologically Complex Languages: A Paraphrase-Based Approach

Improving data augmentation for low resource speech-to-text translation with diverse paraphrasing

Parse-realize based paraphrasing and SMT corpus enriching

Syntax-Aware Data Augmentation for Neural Machine Translation

TreeSwap: Data Augmentation for Machine Translation via Dependency Subtree Swapping

Improving Neural Machine Translation Models with Monolingual Data

Improving Data Augmentation for Low-Resource NMT Guided by POS-Tagging and Paraphrase Embedding

Sentence-Level Paraphrasing for Machine Translation System Combination.

Improving Metrics for Speech Translation

Improving Statistical Machine Translation with monolingual collocation

Improve SMT Quality with Automatically Extracted Paraphrase Rules

Using Multiple Subwords to Improve English-Esperanto Automated Literary Translation Quality

Improving Neural Machine Translation with Neural Syntactic Distance

Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation

ExtraPhrase: Efficient Data Augmentation for Abstractive Summarization

Neural and Statistical Methods for Leveraging Meta-information in Machine Translation

Improving Neural Machine Translation with Pre-trained Representation

Lexical-Constraint-Aware Neural Machine Translation via Data Augmentation