Abstract:While NMT has achieved remarkable results in the last 5 years, production systems come with strict quality requirements in arbitrarily niche domains that are not always adequately covered by readily available parallel corpora. This is typically addressed by training domain specific models, using fine-tuning methods and some variation of back-translation on top of in-domain monolingual corpora. However, industrial practitioners can rarely afford to focus on a single domain. A far more typical scenario includes a set of closely related, yet succinctly different sub-domains. At <a class="link-external link-http" href="http://Booking.com" rel="external noopener nofollow">this http URL</a>, we need to translate property descriptions, user reviews, as well as messages, (for example those sent between a customer and an agent or property manager). An editor might need to translate articles across a set of different topics. An e-commerce platform would typically need to translate both the description of each item and the user generated content related to them. To this end, we propose MDT: a novel method to simultaneously fine-tune on several sub-domains by passing multidimensional sentence-level information to the model during training and inference. We show that MDT achieves results competitive to N specialist models each fine-tuned on a single constituent domain, while effectively serving all N sub-domains, therefore cutting development and maintenance costs by the same factor. Besides BLEU (industry standard automatic evaluation metric known to only weakly correlate with human judgement) we also report rigorous human evaluation results for all models and sub-domains as well as specific examples that better contextualise the performance of each model in terms of adequacy and fluency. To facilitate further research, we plan to make the code available upon acceptance.

An Ensemble Strategy with Gradient Conflict for Multi-Domain Neural Machine Translation

Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks

ICL: Iterative Continual Learning for Multi-domain Neural Machine Translation

Neural Machine Translation Transfer Model Based on Mutual Domain Guidance

Learning Domain Specific Sub-layer Latent Variable for Multi-Domain Adaptation Neural Machine Translation

WDSRL: Multi-Domain Neural Machine Translation with Word-Level Domain-Sensitive Representation Learning

Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination

Exploring Discriminative Word-Level Domain Contexts for Multi-Domain Neural Machine Translation

Multi-Domain Adaptation in Neural Machine Translation Through Multidimensional Tagging

Investigating the potential of Sparse Mixtures-of-Experts for multi-domain neural machine translation

Building a Multi-domain Neural Machine Translation Model using Knowledge Distillation

Exploring Iterative Dual Domain Adaptation for Neural Machine Translation

Domain-Aware Self-Attention for Multi-Domain Neural Machine Translation

On Ensemble Learning of Neural Machine Translation

Label-Free Multi-Domain Machine Translation with Stage-wise Training

Layer-Wise Multi-View Learning for Neural Machine Translation

Progressive modality-complement aggregative multitransformer for domain multi-modal neural machine translation

Unsupervised Multi-Domain Image Translation with Domain-Specific Encoders/Decoders

Multiple Domain-Adversarial Ensemble Learning for Domain Generalization

A Guider Network for Multi-Dual Learning

Transductive Ensemble Learning for Neural Machine Translation.