Abstract:Neural machine translation (NMT) has been bringing exciting news in the field of machine translation since its emergence. However, because NMT only employs single neural networks to convert natural languages, it suffers from two drawbacks in terms of reducing translation time: NMT is more sensitive to sentence length than statistical machine translation and the end-to-end implementation process fails to make explicit use of linguistic knowledge to improve translation performance. The network model performance of various deep learning machine translation tasks was constructed and compared in English-Chinese bilingual direction, and the defects of each network were solved by using an attention mechanism. The problems of gradient disappearance and gradient explosion are easy to occur in the recurrent neural network in the long-distance sequence. The short and long-term memory networks cannot reflect the information weight problems in long-distance sequences. In this study, through the comparison of examples, it is concluded that the introduction of an attention mechanism can improve the attention of context information in the process of model generation of the target language sequence, thus translating restore degree and fluency higher. This study proposes a neural machine translation method based on the divide-and-conquer strategy. Based on the idea of divide-and-conquer, this method identifies and extracts the longest noun phrase in a sentence and retains special identifiers or core words to form a sentence frame with the rest of the sentence. This method of translating the longest noun phrase and sentence frame separately by the neural machine translation system, and then recombining the translation, alleviates the poor performance of neural machine translation in long sentences. Experimental results show that the BLEU score of translation obtained by the proposed method has improved by 0.89 compared with the baseline method.

Recurrent Positional Embedding for Neural Machine Translation.

Neural Machine Translation with Reordering Embeddings.

Explicit Reordering for Neural Machine Translation

Deep Neural Machine Translation with Weakly-Recurrent Units

Non-autoregressive Transformer by Position Learning

Neural Machine Translation with Word Predictions.

What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding

Towards More Diverse Input Representation for Neural Machine Translation

Rethinking Position Embedding Methods in the Transformer Architecture

Efficient transformer with reinforced position embedding for language models

Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabulary

Lattice-Based Recurrent Neural Network Encoders for Neural Machine Translation

Feedforward Sequential Memory Networks Based Encoder-Decoder Model for Machine Translation

Deep Recurrent Models with Fast-Forward Connections for Neural Machine Translation.

Gated Residual Connection for Nerual Machine Translation

Neural Machine Translation with Recurrent Attention Modeling

A bio-inspired positional embedding network for transformer-based models

Context-aware Positional Representation for Self-Attention Networks.

Deep Learning-Based English-Chinese Translation Research

Transformer with Layer Fusion and Interaction

Asynchronous Bidirectional Decoding for Neural Machine Translation.