Abstract:This study aims to analyse how translation experts from the German department of the European Commission’s Directorate-General for Translation (DGT) identify and correct different error categories in neural machine translated texts (NMT) and their post-edited versions (NMTPE). The term translation expert encompasses translator, post-editor as well as revisor. Even though we focus on neural machine-translated segments, translator and post-editor are used synonymously because of the combined workflow using CAT-Tools as well as machine translation. Only the distinction between post-editor, which refers to a DGT translation expert correcting the neural machine translation output, and revisor, which refers to a DGT translation expert correcting the post-edited version of the neural machine translation output, is important and made clear whenever relevant. Using an automatic error annotation tool and the more fine-grained manual error annotation framework to identify characteristic error categories in the DGT texts, a corpus analysis revealed that quality assurance measures by post-editors and revisors of the DGT are most often necessary for lexical errors. More specifically, the corpus analysis showed that, if post-editors correct mistranslations, terminology or stylistic errors in an NMT sentence, revisors are likely to correct the same error type in the same post-edited sentence, suggesting that the DGT experts were being primed by the NMT output. Subsequently, we designed a controlled eye-tracking and key-logging experiment to compare participants’ eye movements for test sentences containing the three identified error categories (mistranslations, terminology or stylistic errors) and for control sentences without errors. We examined the three error types’ effect on early (first fixation durations, first pass durations) and late eye movement measures (e.g., total reading time and regression path durations). Linear mixed-effects regression models predict what kind of behaviour of the DGT experts is associated with the correction of different error types during the post-editing process.

Cognitive effort in human translation and machine translation post-editing processes

A Comparative Study on the Effort of Human Translation and Post-Editing in Relation to Text Types: An Eye-Tracking and Key-Logging Experiment

An eye-tracking study of productivity and effort in Chinese-to-English translation and post-editing

Post-editing Machine Translated Subtitles: Examining the Effects of Non-Verbal Input on Student Translators’ Effort

Multidimensional Comparison of Chinese-English Interpreting Outputs from Human and Machine: Implications for Interpreting Education in the Machine-Translation Age

Identifying the Machine Translation Error Types with the Greatest Impact on Post-editing Effort

Post-editese: an Exacerbated Translationese

The Role of Machine Translation Quality Estimation in the Post-Editing Workflow

Predicting student translators’ performance in machine translation post-editing: interplay of self-regulation, critical thinking, and motivation

Eye-Tracking Study of Cognitive Effort in Processing of Lexical Features in Students and Experts

Man or machine? Comparing the difficulty of human translation versus neural machine translation post-editing

The impact of traditional and interactive post-editing on Machine Translation User Experience, quality, and productivity

Comparing Chinese-English MT Performance Involving ChatGPT and MT Providers and the Efficacy of AI mediated Post-Editing

A cognitive inquiry into similarities and differences between translation and paraphrase: Evidence from eye movement data.

The interaction effect between source text complexity and machine translation quality on the task difficulty of NMT post-editing from English to Chinese: A multi-method study

Is post-editing really faster than human translation?

Translation Quality and Error Recognition in Professional Neural Machine Translation Post-Editing

A New Input Method for Human Translators: Integrating Machine Translation Effectively and Imperceptibly

Comparing the Effect of Product-Based Metrics on the Translation Process

Re-thinking Machine Translation Post-Editing Guidelines

Performance and perception: machine translation post-editing in Chinese-English news translation by novice translators