Abstract:Neural machine translation (NMT) has gained more and more attention in recent years, mainly due to its simplicity yet state-of-the-art performance. However, previous research has shown that NMT suffers from several limitations: source coverage guidance, translation of rare words, and the limited vocabulary, while statistical machine translation (SMT) has complementary properties that correspond well to these limitations. It is straightforward to improve the translation performance by combining the advantages of two kinds of models. This paper proposes a general framework for incorporating the SMT word knowledge into NMT to alleviate above word-level limitations. In our framework, the NMT decoder makes more accurate word prediction by referring to the SMT word recommendations in both training and testing phases. Specifically, the SMT model offers informative word recommendations based on the NMT decoding information. Then, we use the SMT word predictions as prior knowledge to adjust the NMT word generation probability, which unitizes a neural network based classifier to digest the discrete word knowledge. In this paper, we use two model variants to implement the framework, one with a gating mechanism and the other with a direct competition mechanism. Experimental results on Chinese-to-English and English-to-German translation tasks show that the proposed framework can take advantage of the SMT word knowledge and consistently achieve significant improvements over NMT and SMT baseline systems.

Refinements in BTG-based Statistical Machine Translation.

Linguistically Annotated BTG for Statistical Machine Translation.

Optimal Translation Boundaries for BTG-Based Decoding

An Integrated Reordering Model for Statistical Machine Translation

Tree Kernel-based SVM with Structured Syntactic Knowledge for BTG-based Phrase Reordering.

Incorporating Statistical Machine Translation Word Knowledge into Neural Machine Translation

Subgraph based multitext grammar for statistical machine translation

A Probabilistic Approach to Syntax-based Reordering for Statistical Machine Translation.

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Enhancing Statistical Machine Translation with Character Alignment

Syntactic Knowledge via Graph Attention with BERT in Machine Translation

Improved Neural Machine Translation With Smt Features

A Bilingual Graph-Based Semantic Model for Statistical Machine Translation.

Dependency-based bracketing transduction grammar for statistical machine translation

ZZX_MT: the BeiHang MT System for NTCIR-9 PatentMT Task

A Reordering Model Based On Shallow Parsing For Improving Phrase-Based Statistical Machine Translation Systems

A Ranking-based Approach to Word Reordering for Statistical Machine Translation.

An Improved Multi-task Approach to Pre-trained Model Based MT Quality Estimation.

A Decoding Method of System Combination Based on Hypergraph in SMT

Translating Braille into Chinese based on improved CBHG model

A Tree-to-tree Alignment-Based Model for Statistical Machine Translation