Abstract:This paper describes the University of Sydney JD's joint submission of the IWSLT 2021 low resource speech translation task. We participated in the Swahili-English direction and got the best scareBLEU (25.3) score among all the participants. Our constrained system is based on a pipeline framework, i.e. ASR and NMT. We trained our models with the officially provided ASR and MT datasets. The ASR system is based on the open-sourced tool Kaldi and this work mainly explores how to make the most of the NMT models. To reduce the punctuation errors generated by the ASR model, we employ our previous work SlotRefine to train a punctuation correction model. To achieve better translation performance, we explored the most recent effective strategies, including back translation, knowledge distillation, multi-feature reranking and transductive finetuning. For model structure, we tried auto-regressive and non-autoregressive models, respectively. In addition, we proposed two novel pre-train approaches, i.e. de-noising training and bidirectional training to fully exploit the data. Extensive experiments show that adding the above techniques consistently improves the BLEU scores, and the final submission system outperforms the baseline (Transformer ensemble model trained with the original parallel data) by approximately 10.8 BLEU score, achieving the SOTA performance.

The ICT System Description for IWSLT 2008

The ICT Statistical Machine Translation Systems for IWSLT 2007.

The TCH Machine Translation System for IWSLT 2008.

The ICT , CAS MT Systems for the IWSLT 09 Evaluation

ICT System Description for the 2006 TC-STAR Run #2 SLT Evaluation

The Sogou-TIIC Speech Translation System for IWSLT 2018.

LIT Team's System Description for Japanese-Chinese Machine Translation Task in IWSLT 2020.

The MSRA Machine Translation System for IWSLT 2010.

Findings of the IWSLT 2024 Evaluation Campaign

SJTU-NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task

CCMT 2019 Machine Translation Evaluation Report

The USTC-NEL Speech Translation system at IWSLT 2018

NICT's Neural and Statistical Machine Translation Systems for the WMT18 News Translation Task

A Description of Tunable Machine Translation Evaluation Systems in WMT13 Metrics Task

QCRI Machine Translation Systems for IWSLT 16

Microsoft Research Asia's Systems for WMT19

Fine-grained linguistic evaluation for state-of-the-art Machine Translation

Description and Findings of OPPO's Machine Translation Systems for CCMT 2020

The USYD-JD Speech Translation System for IWSLT 2021

DiDi's Machine Translation System for WMT2020

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task