Abstract:Simultaneous machine translation (SiMT) presents a unique challenge as it requires generating target tokens before the source sentence is fully consumed. This can lead to the hallucination problem, where target tokens are generated without support from the source sentence. The prefix-to-prefix training data used to train SiMT models are not always parallel, due to divergent word order between the source and target languages, and can contribute to the problem. In this paper, we propose a novel approach that leverages traditional translation models as teachers and employs a two-stage beam search algorithm to generate monotonic yet accurate reference translations for sequence-level knowledge distillation. Experimental results demonstrate the significant improvements achieved by our approach over multiple strong SiMT baselines, leading to new state-of-the-art performance across various language pairs. Notably, when evaluated on a monotonic version of the WMT15 De -> En test set, which includes references generated in a more monotonic style by professional translators, our approach achieves even more substantial improvement over the baselines. The source code and data are publicly available for further exploration(1).

Improving Pivot-Based Statistical Machine Translation Using Random Walk.

Improving Pivot-Based Statistical Machine Translation by Pivoting the Co-occurrence Count of Phrase Pairs

Topic-aware pivot language approach for statisticalmachine translation

Pivot Language Approach for Phrase-Based Statistical Machine Translation

Revisiting Pivot Language Approach for Machine Translation.

Joint Alignment and Artificial Data Generation: an Empirical Study of Pivot-based Machine Transliteration

Neural Machine Translation with Pivot Languages

Evaluating Indirect Strategies for Chinese-Spanish Statistical Machine Translation

Joint Training for Pivot-based Neural Machine Translation.

End-to-end Training and Decoding for Pivot-based Cascaded Translation Model

Improving Statistical Machine Translation with monolingual collocation

Improving low-resource machine transliteration by using 3-way transfer learning

Pivot-based Transfer Learning for Neural Machine Translation between Non-English Languages

Unsupervised Pivot Translation for Distant Languages

Augmenting Phrase Table by Employing Lexicons for Pivot-based SMT

3 Joint Training for Pivot-based NMT 3 . 1 Training Objective

Better Simultaneous Translation with Monotonic Knowledge Distillation.

An Investigation On Statistical Machine Translation With Neural Language Models

Improved Neural Machine Translation With Smt Features

Improving statistical word alignment with a rule-based machine translation system

Weighted Alignment Matrices for Statistical Machine Translation.