Abstract:While NMT has achieved remarkable results in the last 5 years, production systems come with strict quality requirements in arbitrarily niche domains that are not always adequately covered by readily available parallel corpora. This is typically addressed by training domain specific models, using fine-tuning methods and some variation of back-translation on top of in-domain monolingual corpora. However, industrial practitioners can rarely afford to focus on a single domain. A far more typical scenario includes a set of closely related, yet succinctly different sub-domains. At <a class="link-external link-http" href="http://Booking.com" rel="external noopener nofollow">this http URL</a>, we need to translate property descriptions, user reviews, as well as messages, (for example those sent between a customer and an agent or property manager). An editor might need to translate articles across a set of different topics. An e-commerce platform would typically need to translate both the description of each item and the user generated content related to them. To this end, we propose MDT: a novel method to simultaneously fine-tune on several sub-domains by passing multidimensional sentence-level information to the model during training and inference. We show that MDT achieves results competitive to N specialist models each fine-tuned on a single constituent domain, while effectively serving all N sub-domains, therefore cutting development and maintenance costs by the same factor. Besides BLEU (industry standard automatic evaluation metric known to only weakly correlate with human judgement) we also report rigorous human evaluation results for all models and sub-domains as well as specific examples that better contextualise the performance of each model in terms of adequacy and fluency. To facilitate further research, we plan to make the code available upon acceptance.

Domain Adaptation for Medical Text Translation Using Web Resources

Combining Domain Adaptation Approaches for Medical Text Translation

Domain Adaptation for Statistical Machine Translation

Domain adaptation for statistical machine translation with domain dictionary and monolingual corpora

SMT Domain Adaptation Based on Monolingual Context Information

Finding the Right Recipe for Low Resource Domain Adaptation in Neural Machine Translation

Localising In-Domain Adaptation of Transformer-Based Biomedical Language Models

Localizing in-domain adaptation of transformer-based biomedical language models

Domain Adaptation for Semantic Role Labeling of Clinical Text.

Topic Model Based Adaptation Data Selection for Domain-Specific Machine Translation.

Sentence Selection and Weighting for Neural Machine Translation Domain Adaptation

Translation Model Adaptation for Statistical Machine Translation with Monolingual Topic Information.

Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey

Generalised Unsupervised Domain Adaptation of Neural Machine Translation with Cross-Lingual Data Selection

Domain Adaptation For Smt Using Sentence Weight

From Priest to Doctor: Domain Adaptaion for Low-Resource Neural Machine Translation

Adapting Large Language Models for Automated Summarisation of Electronic Medical Records in Clinical Coding

Bridging the Domain Gap: Improve Informal Language Translation Via Counterfactual Domain Adaptation

Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text.

Multi-Domain Adaptation in Neural Machine Translation Through Multidimensional Tagging

Machine Translation in the Covid domain: an English-Irish case study for LoResMT 2021