Abstract:Since building Neural Machine Translation (NMT) systems requires a large parallel corpus, various data augmentation techniques have been adopted, especially for low-resource languages. In order to achieve the best performance through data augmentation, the NMT systems should be able to evaluate the quality of augmented data. Several studies have addressed data weighting techniques to assess data quality. The basic idea of data weighting adopted in previous studies is the loss value that a system calculates when learning from training data. The weight derived from the loss value of the data, through simple heuristic rules or neural models, can adjust the loss used in the next step of the learning process. In this study, we propose EvalNet, a data evaluation network, to assess parallel data of NMT. EvalNet exploits a loss value, a cross-attention map, and a semantic similarity between parallel data as its features. The cross-attention map is an encoded representation of cross-attention layers of Transformer, which is a base architecture of an NMT system. The semantic similarity is a cosine distance between two semantic embeddings of a source sentence and a target sentence. Owing to the parallelism of data, the combination of the cross-attention map and the semantic similarity proved to be effective features for data quality evaluation, besides the loss value. EvalNet is the first NMT data evaluator network that introduces the cross-attention map and the semantic similarity as its features. Through various experiments, we conclude that EvalNet is simple yet beneficial for robust training of an NMT system and outperforms the previous studies as a data evaluator.

High-Quality Data Augmentation for Low-Resource NMT: Combining a Translation Memory, a GAN Generator, and Filtering

Generative-Adversarial Networks for Low-Resource Language Data Augmentation in Machine Translation

A Scenario-Generic Neural Machine Translation Data Augmentation Method

Data Augmentation for Low‐resource Languages NMT Guided by Constrained Sampling

Improving Data Augmentation for Low-Resource NMT Guided by POS-Tagging and Paraphrase Embedding

Exploiting Multilingualism in Low-resource Neural Machine Translation via Adversarial Learning

Syntax-Aware Data Augmentation for Neural Machine Translation

Detail Fusion GAN: High-Quality Translation for Unpaired Images with GAN-based Data Augmentation

AdMix: A Mixed Sample Data Augmentation Method for Neural Machine Translation

Handling Syntactic Divergence in Low-resource Machine Translation

Sentence Augmentation for Language Translation Using GPT-2

Rethinking Translation Memory Augmented Neural Machine Translation

Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation

Robust Data Augmentation for Neural Machine Translation through EVALNET

AdvAug: Robust Adversarial Augmentation for Neural Machine Translation

Twin-GAN for Neural Machine Translation

Exploiting Monolingual Data at Scale for Neural Machine Translation.

Data Augmentation Based on Generative Adversarial Network with Mixed Attention Mechanism

Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation

Improving data augmentation for low resource speech-to-text translation with diverse paraphrasing

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation