Abstract:Since the 1950s, machine translation (MT) has become one of the important tasks of AI and development, and has experienced several different periods and stages of development, including rule-based methods, statistical methods, and recently proposed neural network-based learning methods. Accompanying these staged leaps is the evaluation research and development of MT, especially the important role of evaluation methods in statistical translation and neural translation research. The evaluation task of MT is not only to evaluate the quality of machine translation, but also to give timely feedback to machine translation researchers on the problems existing in machine translation itself, how to improve and how to optimise. In some practical application fields, such as in the absence of reference translations, the quality estimation of machine translation plays an important role as an indicator to reveal the credibility of automatically translated target languages. This report mainly includes the following contents: a brief history of machine translation evaluation (MTE), the classification of research methods on MTE, and the the cutting-edge progress, including human evaluation, automatic evaluation, and evaluation of evaluation methods (meta-evaluation). Manual evaluation and automatic evaluation include reference-translation based and reference-translation independent participation; automatic evaluation methods include traditional n-gram string matching, models applying syntax and semantics, and deep learning models; evaluation of evaluation methods includes estimating the credibility of human evaluations, the reliability of the automatic evaluation, the reliability of the test set, etc. Advances in cutting-edge evaluation methods include task-based evaluation, using pre-trained language models based on big data, and lightweight optimisation models using distillation techniques.

Research on automatic acquisition of translation template based on error-driven learning method

Automatic Extraction of English-Chinese Translation Templates Based on Deep Learning

Research on Transfer Learning-Based English-Chinese Machine Translation

A Template-based Method for Constrained Neural Machine Translation

An Automatic Error Detection Method for Machine Translation Results Via Deep Learning

Autocorrect in the Process of Translation -- Multi-task Learning Improves Dialogue Machine Translation

Understanding and Improving Lexical Choice in Non-Autoregressive Translation

Fine-grained Human Evaluation of Transformer and Recurrent Approaches to Neural Machine Translation for English-to-Chinese

Active Learning Approaches to Enhancing Neural Machine Translation: an Empirical Study.

Difficulty-Aware Machine Translation Evaluation

Translation Word-Level Auto-Completion: What can we achieve out of the box?

Computer Assisted Translation with Neural Quality Estimation and Automatic Post-Editing

Convergences and Divergences between Automatic Assessment and Human Evaluation: Insights from Comparing ChatGPT-Generated Translation and Neural Machine Translation

An Overview on Machine Translation Evaluation

Learning to Copy for Automatic Post-Editing

Exploring the traditional NMT model and Large Language Model for chat translation

Analysis of Translation Errors in English-Chinese Translation Practice

Enhancing Machine Translation Quality Estimation via Fine-Grained Error Analysis and Large Language Model

Exploration on Advanced Intelligent Algorithms of Artificial Intelligence for Verb Recognition in Machine Translation

Fine Grained Human Evaluation for English-to-Chinese Machine Translation: A Case Study on Scientific Text

Japanese-Chinese Machine Translation of Japanese Determiners Based on Templates