Abstract:Simultaneous machine translation (SiMT) is usually done via sequence-level knowledge distillation (Seq-KD) from a full-sentence neural machine translation (NMT) model. However, there is still a significant performance gap between NMT and SiMT. In this work, we propose to leverage monolingual data to improve SiMT, which trains a SiMT student on the combination of bilingual data and external monolingual data distilled by Seq-KD. Preliminary experiments on En-Zh and En-Ja news domain corpora demonstrate that monolingual data can significantly improve translation quality (e.g., +3.15 BLEU on En-Zh). Inspired by the behavior of human simultaneous interpreters, we propose a novel monolingual sampling strategy for SiMT, considering both chunk length and monotonicity. Experimental results show that our sampling strategy consistently outperforms the random sampling strategy (and other conventional typical NMT monolingual sampling strategies) by avoiding the key problem of SiMT -- hallucination, and has better scalability. We achieve +0.72 BLEU improvements on average against random sampling on En-Zh and En-Ja. Data and codes can be found at <a class="link-external link-https" href="https://github.com/hexuandeng/Mono4SiMT" rel="external noopener nofollow">this https URL</a>.

I Can Guess What You Mean: A Monolingual Query Enhancement for Machine Translation

Query Expansion with Statistical Machine Translation

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Statistical Machine Translation Improves Question Retrieval in Community Question Answering Via Matrix Factorization.

Query Rewriting Using Statistical Machine Translation

A Machine Learning Method to Distinguish Machine Translation from Human Translation.

Don't Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimation

Improving Simultaneous Machine Translation with Monolingual Data

Bridging the Domain Gap: Improve Informal Language Translation Via Counterfactual Domain Adaptation

Improving Statistical Machine Translation with monolingual collocation

Cross-lingual Transfer or Machine Translation? On Data Augmentation for Monolingual Semantic Textual Similarity

Learning Inter-Related Statistical Query Translation Models for English-Chinese Bi-Directional CLIR

Bilingual query translation and expansion for supporting more effective cross-language image retrieval.

Combining multiple sources for short query translation in Chinese-English cross-language information retrieval

Opening Machine Translation Black Box for Cross-Language Information Retrieval

Enriching SMT Training Data Via Paraphrasing.

Anticipating Future with Large Language Model for Simultaneous Machine Translation

Neural and Statistical Methods for Leveraging Meta-information in Machine Translation

Exploiting Neural Query Translation into Cross Lingual Information Retrieval

Research on query translation for clir based on a combination of statistical method and web information

Improved statistical machine translation using monolingual paraphrases