Findings of the Second Workshop on Automatic Simultaneous Translation

Ruiqing Zhang,Chuanqiang Zhang,Zhongjun He,Hua Wu,Haifeng Wang,Liang Huang,Qun Liu,Julia Ive,Wolfgang Macherey
DOI: https://doi.org/10.18653/v1/2021.autosimtrans-1.6
2022-01-01
Abstract:This paper presents the results of the shared task of the 2nd Workshop on Automatic Simultaneous Translation (AutoSimTrans). The task includes two tracks, one for text-to-text translation and one for speech-to-text, requiring participants to build systems to translate from either the source text or speech into the target text. Different from traditional machine translation, the AutoSimTrans shared task evaluates not only translation quality but also latency. We propose a metric “Monotonic Optimal Sequence” (MOS) considering both quality and latency to rank the submissions. We also discuss some important open issues in simultaneous translation.
What problem does this paper attempt to address?