Abstract:Neural machine translation (NMT) has been bringing exciting news in the field of machine translation since its emergence. However, because NMT only employs single neural networks to convert natural languages, it suffers from two drawbacks in terms of reducing translation time: NMT is more sensitive to sentence length than statistical machine translation and the end-to-end implementation process fails to make explicit use of linguistic knowledge to improve translation performance. The network model performance of various deep learning machine translation tasks was constructed and compared in English-Chinese bilingual direction, and the defects of each network were solved by using an attention mechanism. The problems of gradient disappearance and gradient explosion are easy to occur in the recurrent neural network in the long-distance sequence. The short and long-term memory networks cannot reflect the information weight problems in long-distance sequences. In this study, through the comparison of examples, it is concluded that the introduction of an attention mechanism can improve the attention of context information in the process of model generation of the target language sequence, thus translating restore degree and fluency higher. This study proposes a neural machine translation method based on the divide-and-conquer strategy. Based on the idea of divide-and-conquer, this method identifies and extracts the longest noun phrase in a sentence and retains special identifiers or core words to form a sentence frame with the rest of the sentence. This method of translating the longest noun phrase and sentence frame separately by the neural machine translation system, and then recombining the translation, alleviates the poor performance of neural machine translation in long sentences. Experimental results show that the BLEU score of translation obtained by the proposed method has improved by 0.89 compared with the baseline method.

Neural Machine Translation with Sentence-Level Topic Context

Towards Making the Most of Context in Neural Machine Translation

Learning Contextualized Sentence Representations for Document-Level Neural Machine Translation

Exploiting Cross-Sentence Context for Neural Machine Translation

Diving Deep into Context-Aware Neural Machine Translation

A Context-Aware Topic Model for Statistical Machine Translation.

Selective Attention for Context-aware Neural Machine Translation

Context-Adaptive Document-Level Neural Machine Translation

Adaptation of Language Models for SMT Using Neural Networks with Topic Information.

Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination

Document-level Neural Machine Translation with Inter-Sentence Attention

Context-Aware Learning for Neural Machine Translation

A Neural Approach to Source Dependence Based Context Model for Statistical Machine Translation

Syntax-Directed Attention for Neural Machine Translation

Improving Neural Machine Translation with Pre-trained Representation

Neural Machine Translation with Extended Context

Context-Aware Smoothing for Neural Machine Translation.

Neural Machine Translation with Target-Attention Model.

Content Word Aware Neural Machine Translation.

Context-Dependent Translation Selection Using Convolutional Neural Network

Deep Learning-Based English-Chinese Translation Research