Abstract:This paper describes the Microsoft Translator submissions to the WMT19 news translation shared task for English-German. Our main focus is document-level neural machine translation with deep transformer models. We start with strong sentence-level baselines, trained on large-scale data created via data-filtering and noisy back-translation and find that back-translation seems to mainly help with translationese input. We explore fine-tuning techniques, deeper models and different ensembling strategies to counter these effects. Using document boundaries present in the authentic and synthetic parallel data, we create sequences of up to 1000 subword segments and train transformer translation models. We experiment with data augmentation techniques for the smaller authentic data with document-boundaries and for larger authentic data without boundaries. We further explore multi-task training for the incorporation of document-level source language monolingual data via the BERT-objective on the encoder and two-pass decoding for combinations of sentence-level and document-level systems. Based on preliminary human evaluation results, evaluators strongly prefer the document-level systems over our comparable sentence-level system. The document-level systems also seem to score higher than the human references in source-based direct assessment.

Findings of the 2017 Conference on Machine Translation (WMT17).

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet

Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs

Findings of the WMT 2024 Shared Task on Chat Translation

CCMT 2019 Machine Translation Evaluation Report

Findings of the IWSLT 2024 Evaluation Campaign

Description and Findings of OPPO's Machine Translation Systems for CCMT 2020

Machine translation and people

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

The University of Edinburgh's Neural MT Systems for WMT17

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task

Fine-grained linguistic evaluation for state-of-the-art Machine Translation

Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation

Reassessing Claims of Human Parity and Super-Human Performance in Machine Translation at WMT 2019

Microsoft Translator at WMT 2019: Towards Large-Scale Document-Level Neural Machine Translation

LIUM Machine Translation Systems for WMT17 News Translation Task

The University of Helsinki submissions to the WMT19 news translation task

Exploring the traditional NMT model and Large Language Model for chat translation

Microsoft Research Asia's Systems for WMT19

SYSTRAN Purely Neural MT Engines for WMT2017

The Multi-Range Theory of Translation Quality Measurement: MQM scoring models and Statistical Quality Control