Abstract:Training Neural Machine Translation (NMT) models suffers from sparse parallel data, in the infrequent translation scenarios towards low-resource source languages. The existing solutions primarily concentrate on the utilization of Parent-Child (PC) transfer learning. It transfers well-trained NMT models on high-resource languages (namely Parent NMT) to low-resource languages, so as to produce Child NMT models by fine-tuning. It has been carefully demonstrated that a variety of PC variants yield significant improvements for low-resource NMT. In this paper, we intend to enhance PC-based NMT by a bidirectionally-adaptive learning strategy. Specifically, we divide inner constituents (6 transformers) of Parent encoder into two “teams”, i.e., T1 and T2. During representation learning, T1 learns to encode low-resource languages conditioned on bilingual shareable latent space. Generative adversarial network and masked language modeling are used for space-shareable encoding. On the other hand, T2 is straightforwardly transferred to low-resource languages, and fine-tuned together with T1 for low-resource translation. Briefly, T1 and T2 take actions separately for different goals. The former aims to adapt to characteristics of low-resource languages during encoding, while the latter adapts to translation experiences learned from high-resource languages. We experiment on benchmark corpora SETIMES, conducting low-resource NMT for Albanian (Sq), Macedonian (Mk), Croatian (Hr) and Romanian (Ro). Experimental results show that our method yields substantial improvements, which allows the NMT performance to reach BLEU4-scores of 62.24%, 56.93%, 50.53% and 54.65% for Sq, Mk, Hr and Ro, respectively.

Enhancing Neural Machine Translation of Low-Resource Languages: Corpus Development, Human Evaluation and Explainable AI Architectures

Transformers for Low-Resource Languages:Is Féidir Linn!

Neural Machine Translation for Low-Resource Languages: A Survey

Akan-English: Transformer for Low Resource Translation

Machine Translation in Low-Resource Languages by an Adversarial Neural Network

A Survey on Low-Resource Neural Machine Translation

Low-Resource Neural Machine Translation: Methods and Trends

Human Evaluation of English--Irish Transformer-Based NMT

Low Resource Arabic Dialects Transformer Neural Machine Translation Improvement through Incremental Transfer of Shared Linguistic Features

Attention Link: An Efficient Attention-Based Low Resource Machine Translation Architecture

Towards Neural No-Resource Language Translation: A Comparative Evaluation of Approaches

Enriching the Transformer with Linguistic Factors for Low-Resource Machine Translation

Relevance-guided Neural Machine Translation

Machine Translation of Low-Resource Indo-European Languages

Low-Resource Machine Translation Training Curriculum Fit for Low-Resource Languages

Meta-Learning for Low-Resource Neural Machine Translation.

Application of Low-resource Machine Translation Techniques to Russian-Tatar Language Pair

Taking Actions Separately: A Bidirectionally-Adaptive Transfer Learning Method for Low-Resource Neural Machine Translation.

Investigating Neural Machine Translation for Low-Resource Languages: Using Bavarian as a Case Study

Pseudotext Injection and Advance Filtering of Low-Resource Corpus for Neural Machine Translation.