Abstract:While NMT has achieved remarkable results in the last 5 years, production systems come with strict quality requirements in arbitrarily niche domains that are not always adequately covered by readily available parallel corpora. This is typically addressed by training domain specific models, using fine-tuning methods and some variation of back-translation on top of in-domain monolingual corpora. However, industrial practitioners can rarely afford to focus on a single domain. A far more typical scenario includes a set of closely related, yet succinctly different sub-domains. At <a class="link-external link-http" href="http://Booking.com" rel="external noopener nofollow">this http URL</a>, we need to translate property descriptions, user reviews, as well as messages, (for example those sent between a customer and an agent or property manager). An editor might need to translate articles across a set of different topics. An e-commerce platform would typically need to translate both the description of each item and the user generated content related to them. To this end, we propose MDT: a novel method to simultaneously fine-tune on several sub-domains by passing multidimensional sentence-level information to the model during training and inference. We show that MDT achieves results competitive to N specialist models each fine-tuned on a single constituent domain, while effectively serving all N sub-domains, therefore cutting development and maintenance costs by the same factor. Besides BLEU (industry standard automatic evaluation metric known to only weakly correlate with human judgement) we also report rigorous human evaluation results for all models and sub-domains as well as specific examples that better contextualise the performance of each model in terms of adequacy and fluency. To facilitate further research, we plan to make the code available upon acceptance.

Defining Boundaries: The Impact of Domain Specification on Cross-Language and Cross-Domain Transfer in Machine Translation

To Translate or Not to Translate: A Systematic Investigation of Translation-Based Cross-Lingual Transfer to Low-Resource Languages

Analysing Cross-Lingual Transfer in Low-Resourced African Named Entity Recognition

Multilingual Neural Machine Translation for Zero-Resource Languages

Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets

Translation Artifacts in Cross-lingual Transfer Learning

Cross-lingual Pre-training Based Transfer for Zero-shot Neural Machine Translation.

Domain Robustness in Neural Machine Translation

Cross-lingual Transfer of Monolingual Models

Cross lingual transfer learning for zero-resource domain adaptation

Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters

An Efficient Approach for Studying Cross-Lingual Transfer in Multilingual Language Models

Zero-shot Cross-lingual Transfer Learning with Multiple Source and Target Languages for Information Extraction: Language Selection and Adversarial Training

Domain, Translationese and Noise in Synthetic Data for Neural Machine Translation

Improving Zero-shot Multilingual Neural Machine Translation by Leveraging Cross-lingual Consistency Regularization

The (In)Effectiveness of Intermediate Task Training For Domain Adaptation and Cross-Lingual Transfer Learning

Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource Settings

Multi-Domain Adaptation in Neural Machine Translation Through Multidimensional Tagging

Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models

Zero-Shot Cross-Lingual Transfer in Legal Domain Using Transformer Models

Is Translation Helpful? An Empirical Analysis of Cross-Lingual Transfer in Low-Resource Dialog Generation