Abstract:Simultaneous machine translation (SiMT) presents a unique challenge as it requires generating target tokens before the source sentence is fully consumed. This can lead to the hallucination problem, where target tokens are generated without support from the source sentence. The prefix-to-prefix training data used to train SiMT models are not always parallel, due to divergent word order between the source and target languages, and can contribute to the problem. In this paper, we propose a novel approach that leverages traditional translation models as teachers and employs a two-stage beam search algorithm to generate monotonic yet accurate reference translations for sequence-level knowledge distillation. Experimental results demonstrate the significant improvements achieved by our approach over multiple strong SiMT baselines, leading to new state-of-the-art performance across various language pairs. Notably, when evaluated on a monotonic version of the WMT15 De -> En test set, which includes references generated in a more monotonic style by professional translators, our approach achieves even more substantial improvement over the baselines. The source code and data are publicly available for further exploration(1).

Learning synchronous context-free grammars with multiple specialised non-terminals for hierarchical phrase-based translation

A Head-Annotated Synchronous Context-Free Grammar for Hierarchical Phrase-Based Translation

Learning Semantic Representations for Nonterminals in Hierarchical Phrase-Based Translation.

A Joint Rule Selection Model for Hierarchical Phrase-Based Translation.

An Improved Hierarchical Phrase Based Machine Translation Model

Soft Syntactic Constraints for Hierarchical Phrase-Based Translation Using Latent Syntactic Distributions.

Syntactically Guided Neural Machine Translation

Using Features from Topic Models to Alleviate Over-Generation in Hierarchical Phrase-Based Translation

Hierarchical Phrase Table Combination for Machine Translation.

Tree-State Based Rule Selection Models for Hierarchical Phrase-Based Machine Translation.

A Lexicalized Reordering Model for Hierarchical Phrase-based Translation

A SP synchronous generation model for statistical machine translation 1

Neural Network Translation Models for Grammatical Error Correction

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Learning Hierarchical Translation Spans.

A Unified and Discriminative Soft Syntactic Constraint Model for Hierarchical Phrase-based Translation.

Syntax-Based Context Representation for Statistical Machine Translation.

Subgraph based multitext grammar for statistical machine translation

Learning Bilingual Distributed Phrase Represenations for Statistical Machine Translation

Synchronous Constituent Context Model for Inducing Bilingual Synchronous Structures

Grammar Comparison Study for Translational Equivalence Modeling and Statistical Machine Translation.