Abstract:Neural machine translation (NMT) has been bringing exciting news in the field of machine translation since its emergence. However, because NMT only employs single neural networks to convert natural languages, it suffers from two drawbacks in terms of reducing translation time: NMT is more sensitive to sentence length than statistical machine translation and the end-to-end implementation process fails to make explicit use of linguistic knowledge to improve translation performance. The network model performance of various deep learning machine translation tasks was constructed and compared in English-Chinese bilingual direction, and the defects of each network were solved by using an attention mechanism. The problems of gradient disappearance and gradient explosion are easy to occur in the recurrent neural network in the long-distance sequence. The short and long-term memory networks cannot reflect the information weight problems in long-distance sequences. In this study, through the comparison of examples, it is concluded that the introduction of an attention mechanism can improve the attention of context information in the process of model generation of the target language sequence, thus translating restore degree and fluency higher. This study proposes a neural machine translation method based on the divide-and-conquer strategy. Based on the idea of divide-and-conquer, this method identifies and extracts the longest noun phrase in a sentence and retains special identifiers or core words to form a sentence frame with the rest of the sentence. This method of translating the longest noun phrase and sentence frame separately by the neural machine translation system, and then recombining the translation, alleviates the poor performance of neural machine translation in long sentences. Experimental results show that the BLEU score of translation obtained by the proposed method has improved by 0.89 compared with the baseline method.

Paragraph-Parallel Based Neural Machine Translation Model with Hierarchical Attention

Paragraph-Level Hierarchical Neural Machine Translation

A Hierarchy-to-Sequence Attentional Neural Machine Translation Model.

Context Modeling with Hierarchical Shallow Attention Structure for Document-Level NMT

Neural Machine Translation Research Based on the Semantic Vector of the Tri-Lingual Parallel Corpus

Deep Learning-Based English-Chinese Translation Research

Multi-channel Encoder for Neural Machine Translation

Research on Mongolian-Chinese Translation Model Based on Transformer with Soft Context Data Augmentation Technique

Document-level Neural Machine Translation with Inter-Sentence Attention

Modeling Discourse Structure for Document-level Neural Machine Translation

Training Deeper Neural Machine Translation Models with Transparent Attention

Towards Neural Machine Translation with Partially Aligned Corpora

Character-Aware Low-Resource Neural Machine Translation With Weight Sharing And Pre-Training

Universal Vector Neural Machine Translation With Effective Attention

Diving Deep into Context-Aware Neural Machine Translation

Enhanced Neural Machine Translation by Joint Decoding with Word and POS-tagging Sequences.

Neural Machine Translation with Target-Attention Model.

Improved Neural Machine Translation with a Syntax-Aware Encoder and Decoder

Accelerating Transformer for Neural Machine Translation.

Modeling Past and Future for Neural Machine Translation

Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training.