Abstract:Machine translation, which will be used widely in human-computer interaction services to Internet of Things (IoT), is a key technology in artificial intelligence field. This paper presents a minimum Bayes-risk (MBR) phrase table pruning method for pivot-based statistical machine translation (SMT). The SMT system requires a great amount of bilingual data to build a high-performance translation model. For some language pairs, such as Chinese-English, massive bilingual data are available on the web. However, for most language pairs, large-scale bilingual data are hard to obtain. Pivot-based SMT is proposed to solve the data scarcity problem: it introduces a pivot language to bridge the source language and the target language. Therefore, a source-target translation model based on well-trained source-pivot and pivot-target translation models can be derived with the pivot-based approach. However, due to the ambiguities of the pivot language, source and target phrases with different meanings may be wrongly matched. Consequently, the derived source-target phrase table may contain incorrect phrase pairs. To alleviate this problem, we apply the MBR method to prune the phrase table. The MBR pruning method removes the phrase pairs with the lowest risk from the phrase table. Experimental results on Europarl data show that the proposed method can both reduce the size of phrase tables and improve the performance of translations. This study also gives a useful reference to many IoT research field and smart web services.

Pivot probability induction for statistical machine translation with topic similarity

Topic-aware pivot language approach for statisticalmachine translation

Improving Pivot-Based Statistical Machine Translation by Pivoting the Co-occurrence Count of Phrase Pairs

Pivot Language Approach for Phrase-Based Statistical Machine Translation

Improving Pivot-Based Statistical Machine Translation Using Random Walk.

Revisiting Pivot Language Approach for Machine Translation.

Context-extended Phrase Reordering Model for Pivot-Based Statistical Machine Translation.

Neural Machine Translation with Pivot Languages

Machine transliteration: leveraging on third languages

Joint Training for Pivot-based Neural Machine Translation.

Minimum Bayes-Risk Phrase Table Pruning For Pivot-Based Machine Translation In Internet Of Things

A Topic Similarity Model for Hierarchical Phrase-based Translation.

Augmenting Phrase Table by Employing Lexicons for Pivot-based SMT

Pivot-based Transfer Learning for Neural Machine Translation between Non-English Languages

Simultaneous Multi-Pivot Neural Machine Translation

A Topic-Triggered Translation Model for Statistical Machine Translation

Evaluating Indirect Strategies for Chinese-Spanish Statistical Machine Translation

End-to-end Training and Decoding for Pivot-based Cascaded Translation Model

Unsupervised Pivot Translation for Distant Languages

3 Joint Training for Pivot-based NMT 3 . 1 Training Objective

Translation Model Adaptation for Statistical Machine Translation with Monolingual Topic Information.