Abstract:This paper proposes an English-Chinese machine translation research method based on transfer learning. First, it expounds the theory of neural machine translation and transfer learning and related technologies. Neural machine translation is discussed, the advantages and disadvantages of various models are introduced, and the transformer neural machine translation model framework is selected. For low-resource Chinese-English parallel corpus and Tibetan-Chinese parallel corpus, 30 million Chinese-English parallel corpora, 100,000 Chinese-English low-resource parallel corpora, and 100,000 Tibetan-Chinese parallel corpora were used to pretrain the transformer machine translation architecture. The decoders are all composed of 6 identical hidden layers, the initialization of the model parameters is done by the transformer uniform distribution, and the model training uses Adam as the optimizer. In the model transfer part, the parameters with the better effect of the pretrained model are transferred to the low-resource Chinese-English and Tibetan-Chinese machine translation model training, so as to achieve the purpose of knowledge transfer. The results show that the model transfer learning of low-resource Chinese-English parallel corpus improves the translation system's translation by 3.97 BLEU values compared with the translation system without transfer learning at 0.34 BLEU values. Model transfer learning on low-resource Tibetan-Chinese parallel corpus increases the BLEU value by 2.64 BLEU compared to the translation system without transfer learning. The neural machine translation system that uses BPE technology for preprocessing plus model transfer learning is compared to the translation system that only performs transfer learning and shows an improved 0.26 BLEU value.It is verified that the transfer learning method proposed in this paper has a certain improvement in the effect of low-resource Chinese-English and Tibetan-Chinese neural machine translation models.

Mongolian-Chinese Unsupervised Neural Machine Translation With Lexical Feature

Semi-Supervised Learning for Neural Machine Translation

Unsupervised Neural Dialect Translation with Commonality and Diversity Modeling

Bidirectional Boost: On Improving Tibetan-Chinese Neural Machine Translation With Back-Translation and Self-Learning

Improving Multilingual Neural Machine Translation by Utilizing Semantic and Linguistic Features

Deep Learning-Based English-Chinese Translation Research

Machine Translation With Weakly Paired Bilingual Documents

Performance Comparison of Neural Machine Translation Systems in Uyghur-Chinese Translation

Research on the LSTM Mongolian and Chinese machine translation based on morpheme encoding

Language Model-Driven Unsupervised Neural Machine Translation

Exploiting Cross-Sentence Context for Neural Machine Translation

Unsupervised Mandarin-Cantonese Machine Translation

English-Chinese Machine Translation Based on Transfer Learning and Chinese-English Corpus

Enhancing Neural Machine Translation with Semantic Units

Adversarial Training for Unknown Word Problems in Neural Machine Translation

A Deep Investigation of RNN and Self-attention for the Cyrillic-Traditional Mongolian Bidirectional Conversion

Unsupervised Transfer Learning in Multilingual Neural Machine Translation with Cross-Lingual Word Embeddings

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation

Tsinghua University Neural Machine Translation Systems for CCMT 2020

Machine Translation with Weakly Paired Documents.

A neural machine translation method based on split graph convolutional self-attention encoding