Abstract:Accurate translation of entities (e.g., person names, organizations, geography) is important in neural machine translation (briefly, NMT), as they are usually more difficult to translate than other words, and an incorrect translation of them will greatly hurt user experiences. In previous works, entities are either treated in the same way as other words, which leads to inaccurate translation, or handled by multiple steps (including named entity recognition, translation, and replacing entities back), which significantly increase the inference latency. In this work, we propose an end-to-end algorithm that carefully handles the translation of entities. There are mainly two novel parts compared to conventional NMT model: (1) The encoder and the decoder are attached with entity classifiers, which are used to verify whether the input token is a named entity. In this way, the encoder and decoder are capable to treat named entities differently; (2) The translation loss of each target token is adaptively increased by the probability that the target token is a named entity, which results in more accurate translation of entities. During inference time, these two parts will be removed so that the translation model maintains the same inference speed as conventional NMT models. Empirical results on six translation tasks demonstrate the effectiveness of our methods of improving the translation quality. Specifically, we improve 1.7 BLEU scores on Japanese to English translation and 4.6 entity F1\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$F_{1}$$\end{document} scores on English to Chinese translation, without additional inference cost.

The Technical Analyses of Named Entity Translation

Efficient Entity Translation Mining

Translation of English-Chinese Person Name Based on Dictionary, Bilingual Corpus and Web Mining.

An Approach to Extract Named Entity Translingual Equivalence

A Study of Legal Translation from the Perspective of Error Analysis

English-Chinese Name Translation Based on Web Mining

Class-based Named Entity Translation in a Speech to Speech Translation System.

Semantic Analysis and Evaluation of Translation Based on Abstract Meaning Representation

Aspects of Terminological and Named Entity Knowledge within Rule-Based Machine Translation Models for Under-Resourced Neural Machine Translation Scenarios

Development of Translation Database based on Chinese-English parallel corpora

Named entity translation method based on machine translation lexicon

Recent Advances in Named Entity Recognition: A Comprehensive Survey and Comparative Study

Web-Based Terminology Translation Mining

Efficient Entity Translation Mining: A Parallelized Graph Alignment Approach

Mining Name Translations from Entity Graph Mapping.

A Study of English Vocabulary Translation Based on Quantitative and Qualitative Analysis of Internet Database

A semantic similarity analysis of multiple English translations of The Analects: Based on a natural language processing algorithm

End-to-end entity-aware neural machine translation

Exploring English Long Sentence Translation Methods by Applying Natural Language Processing Techniques

A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

What Have We Achieved on Non-autoregressive Translation?