Abstract:While NMT has achieved remarkable results in the last 5 years, production systems come with strict quality requirements in arbitrarily niche domains that are not always adequately covered by readily available parallel corpora. This is typically addressed by training domain specific models, using fine-tuning methods and some variation of back-translation on top of in-domain monolingual corpora. However, industrial practitioners can rarely afford to focus on a single domain. A far more typical scenario includes a set of closely related, yet succinctly different sub-domains. At <a class="link-external link-http" href="http://Booking.com" rel="external noopener nofollow">this http URL</a>, we need to translate property descriptions, user reviews, as well as messages, (for example those sent between a customer and an agent or property manager). An editor might need to translate articles across a set of different topics. An e-commerce platform would typically need to translate both the description of each item and the user generated content related to them. To this end, we propose MDT: a novel method to simultaneously fine-tune on several sub-domains by passing multidimensional sentence-level information to the model during training and inference. We show that MDT achieves results competitive to N specialist models each fine-tuned on a single constituent domain, while effectively serving all N sub-domains, therefore cutting development and maintenance costs by the same factor. Besides BLEU (industry standard automatic evaluation metric known to only weakly correlate with human judgement) we also report rigorous human evaluation results for all models and sub-domains as well as specific examples that better contextualise the performance of each model in terms of adequacy and fluency. To facilitate further research, we plan to make the code available upon acceptance.

Machine Translation of Restaurant Reviews: New Corpus for Domain Adaptation and Robustness

Bilingual Corpus Mining and Multistage Fine-Tuning for Improving Machine Translation of Lecture Transcripts

Multi-domain machine translation enhancements by parallel data extraction from comparable corpora

Naver Labs Europe's Systems for the WMT19 Machine Translation Robustness Task

Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation

Multi-Domain Adaptation in Neural Machine Translation Through Multidimensional Tagging

Domain, Translationese and Noise in Synthetic Data for Neural Machine Translation

Machine Translation: Phrase-Based, Rule-Based and Neural Approaches with Linguistic Evaluation

Neural machine translation, corpus and frugality

Augmenting Librispeech with French Translations: A Multimodal Corpus for Direct Speech Translation Evaluation

Pseudotext Injection and Advance Filtering of Low-Resource Corpus for Neural Machine Translation.

A Corpus for English-Japanese Multimodal Neural Machine Translation with Comparable Sentences

A Multi-task Learning Framework for Evaluating Machine Translation of Emotion-loaded User-generated Content

The early days of contemporary philosophy of science: novel insights from machine translation and topic-modeling of non-parallel multilingual corpora

Discourse Centric Evaluation of Machine Translation with a Densely Annotated Parallel Corpus

Inflating a Small Parallel Corpus into a Large Quasi-parallel Corpus Using Monolingual Data for Chinese-Japanese Machine Translation.

The Multilingual Amazon Reviews Corpus

Marathi To English Neural Machine Translation With Near Perfect Corpus And Transformers

Finding the Right Recipe for Low Resource Domain Adaptation in Neural Machine Translation

Parallel Corpus for Indigenous Language Translation: Spanish-Mazatec and Spanish-Mixtec

Web-based parallel corpora for statistical machine translation