Abstract:This paper proposes an English-Chinese machine translation research method based on transfer learning. First, it expounds the theory of neural machine translation and transfer learning and related technologies. Neural machine translation is discussed, the advantages and disadvantages of various models are introduced, and the transformer neural machine translation model framework is selected. For low-resource Chinese-English parallel corpus and Tibetan-Chinese parallel corpus, 30 million Chinese-English parallel corpora, 100,000 Chinese-English low-resource parallel corpora, and 100,000 Tibetan-Chinese parallel corpora were used to pretrain the transformer machine translation architecture. The decoders are all composed of 6 identical hidden layers, the initialization of the model parameters is done by the transformer uniform distribution, and the model training uses Adam as the optimizer. In the model transfer part, the parameters with the better effect of the pretrained model are transferred to the low-resource Chinese-English and Tibetan-Chinese machine translation model training, so as to achieve the purpose of knowledge transfer. The results show that the model transfer learning of low-resource Chinese-English parallel corpus improves the translation system's translation by 3.97 BLEU values compared with the translation system without transfer learning at 0.34 BLEU values. Model transfer learning on low-resource Tibetan-Chinese parallel corpus increases the BLEU value by 2.64 BLEU compared to the translation system without transfer learning. The neural machine translation system that uses BPE technology for preprocessing plus model transfer learning is compared to the translation system that only performs transfer learning and shows an improved 0.26 BLEU value.It is verified that the transfer learning method proposed in this paper has a certain improvement in the effect of low-resource Chinese-English and Tibetan-Chinese neural machine translation models.

Bidirectional Boost: On Improving Tibetan-Chinese Neural Machine Translation With Back-Translation and Self-Learning

Improving Neural Machine Translation by Bidirectional Training

Exploiting Reverse Target-Side Contexts for Neural Machine Translation Via Asynchronous Bidirectional Decoding

Research on Tibetan-Chinese Neural Machine Translation

Asynchronous Bidirectional Decoding for Neural Machine Translation.

Synchronous Bidirectional Neural Machine Translation

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation

Reciprocal Supervised Learning Improves Neural Machine Translation

Enhanced back-translation for low resource neural machine translation using self-training

Deep Learning-Based English-Chinese Translation Research

Improving Many-to-Many Neural Machine Translation Via Selective and Aligned Online Data Augmentation

Bridging the Data Gap Between Training and Inference for Unsupervised Neural Machine Translation

Neural System Combination For Machine Translation

A Hybrid Approach for Improved Low Resource Neural Machine Translation using Monolingual Data

English-Chinese Machine Translation Based on Transfer Learning and Chinese-English Corpus

Joint Training for Neural Machine Translation Models with Monolingual Data

Confidence Based Bidirectional Global Context Aware Training Framework for Neural Machine Translation

Handling Syntactic Divergence in Low-resource Machine Translation

Improving Language Transfer Capability of Decoder-only Architecture in Multilingual Neural Machine Translation

Rethinking the Exploitation of Monolingual Data for Low-Resource Neural Machine Translation

Bridging Neural Machine Translation and Bilingual Dictionaries