Abstract:This paper proposes an English-Chinese machine translation research method based on transfer learning. First, it expounds the theory of neural machine translation and transfer learning and related technologies. Neural machine translation is discussed, the advantages and disadvantages of various models are introduced, and the transformer neural machine translation model framework is selected. For low-resource Chinese-English parallel corpus and Tibetan-Chinese parallel corpus, 30 million Chinese-English parallel corpora, 100,000 Chinese-English low-resource parallel corpora, and 100,000 Tibetan-Chinese parallel corpora were used to pretrain the transformer machine translation architecture. The decoders are all composed of 6 identical hidden layers, the initialization of the model parameters is done by the transformer uniform distribution, and the model training uses Adam as the optimizer. In the model transfer part, the parameters with the better effect of the pretrained model are transferred to the low-resource Chinese-English and Tibetan-Chinese machine translation model training, so as to achieve the purpose of knowledge transfer. The results show that the model transfer learning of low-resource Chinese-English parallel corpus improves the translation system's translation by 3.97 BLEU values compared with the translation system without transfer learning at 0.34 BLEU values. Model transfer learning on low-resource Tibetan-Chinese parallel corpus increases the BLEU value by 2.64 BLEU compared to the translation system without transfer learning. The neural machine translation system that uses BPE technology for preprocessing plus model transfer learning is compared to the translation system that only performs transfer learning and shows an improved 0.26 BLEU value.It is verified that the transfer learning method proposed in this paper has a certain improvement in the effect of low-resource Chinese-English and Tibetan-Chinese neural machine translation models.

Knn-Tl: K-Nearest-neighbor Transfer Learning for Low-Resource Neural Machine Translation.

Faster Nearest Neighbor Machine Translation

Efficient Cluster-Based k-Nearest-Neighbor Machine Translation

Adaptive Nearest Neighbor Machine Translation.

Multi-Round Transfer Learning for Low-Resource NMT Using Multiple High-Resource Languages

Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval

Enriching the Transfer Learning with Pre-Trained Lexicon Embedding for Low-Resource Neural Machine Translation

ConsistTL: Modeling Consistency in Transfer Learning for Low-Resource Neural Machine Translation

Nearest Neighbor Knowledge Distillation for Neural Machine Translation.

Towards Robust k-Nearest-Neighbor Machine Translation

Zero-Resource Multilingual Model Transfer: Learning What to Share

A Universal Parent Model for Low-Resource Neural Machine Translation Transfer

Towards better Chinese-centric neural machine translation for low-resource languages

Multi-granularity Knowledge Sharing in Low-resource Neural Machine Translation

Converse Attention Knowledge Transfer for Low-Resource Named Entity Recognition

English-Chinese Machine Translation Based on Transfer Learning and Chinese-English Corpus

Multilingual Neural Machine Translation with Language Clustering

Transfer Learning across Low-Resource, Related Languages for Neural Machine Translation

Language Graph Distillation for Low-Resource Machine Translation

Better Datastore, Better Translation: Generating Datastores from Pre-Trained Models for Nearest Neural Machine Translation

Transfer Deep Learning for Low-Resource Chinese Word Segmentation with a Novel Neural Network