Abstract:In this paper, we describe our MiSS system that participated in the WMT21 news translation task. We mainly participated in the evaluation of the three translation directions of English-Chinese and Japanese-English translation tasks. In the systems submitted, we primarily considered wider networks, deeper networks, relative positional encoding, and dynamic convolutional networks in terms of model structure, while in terms of training, we investigated contrastive learning-reinforced domain adaptation, self-supervised training, and optimization objective switching training methods. According to the final evaluation results, a deeper, wider, and stronger network can improve translation performance in general, yet our data domain adaption method can improve performance even more. In addition, we found that switching to the use of our proposed objective during the finetune phase using relatively small domain-related data can effectively improve the stability of the model’s convergence and achieve better optimal performance.

NICT's Unsupervised Neural and Statistical Machine Translation Systems for the WMT19 News Translation Task

NICT's Neural and Statistical Machine Translation Systems for the WMT18 News Translation Task

SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

NICT’s Machine Translation Systems for CCMT-2019 Translation Task

English-Myanmar Supervised and Unsupervised NMT: NICT’s Machine Translation Systems at WAT-2019

The NiuTrans Machine Translation Systems for WMT19

Kingsoft’s Neural Machine Translation System for WMT19

The University of Edinburgh's Submissions to the WMT19 News Translation Task

The NiuTrans Machine Translation Systems for WMT20

WeChat Neural Machine Translation Systems for WMT21

The University of Edinburgh's Neural MT Systems for WMT17

LIUM Machine Translation Systems for WMT17 News Translation Task

The NiuTrans Machine Translation Systems for WMT21.

HW-TSC's Participation in the WMT 2021 News Translation Shared Task.

Edinburgh Neural Machine Translation Systems for WMT 16

HW-TSC's Participation in the WMT 2020 News Translation Shared Task.

Nict'S Neural Machine Translation Systems For The Wat21 Restricted Translation Task

MiSS@WMT21 - Contrastive Learning-reinforced Domain Adaptation in Neural Machine Translation.

The AMU-UEDIN Submission to the WMT16 News Translation Task: Attention-based NMT Models as Feature Functions in Phrase-based SMT

NTT's Machine Translation Systems for WMT19 Robustness Task

WeChat Neural Machine Translation Systems for WMT20