Abstract:This study aims to analyse how translation experts from the German department of the European Commission’s Directorate-General for Translation (DGT) identify and correct different error categories in neural machine translated texts (NMT) and their post-edited versions (NMTPE). The term translation expert encompasses translator, post-editor as well as revisor. Even though we focus on neural machine-translated segments, translator and post-editor are used synonymously because of the combined workflow using CAT-Tools as well as machine translation. Only the distinction between post-editor, which refers to a DGT translation expert correcting the neural machine translation output, and revisor, which refers to a DGT translation expert correcting the post-edited version of the neural machine translation output, is important and made clear whenever relevant. Using an automatic error annotation tool and the more fine-grained manual error annotation framework to identify characteristic error categories in the DGT texts, a corpus analysis revealed that quality assurance measures by post-editors and revisors of the DGT are most often necessary for lexical errors. More specifically, the corpus analysis showed that, if post-editors correct mistranslations, terminology or stylistic errors in an NMT sentence, revisors are likely to correct the same error type in the same post-edited sentence, suggesting that the DGT experts were being primed by the NMT output. Subsequently, we designed a controlled eye-tracking and key-logging experiment to compare participants’ eye movements for test sentences containing the three identified error categories (mistranslations, terminology or stylistic errors) and for control sentences without errors. We examined the three error types’ effect on early (first fixation durations, first pass durations) and late eye movement measures (e.g., total reading time and regression path durations). Linear mixed-effects regression models predict what kind of behaviour of the DGT experts is associated with the correction of different error types during the post-editing process.

Using Machine Translation and Post-Editing in the TRAPD Approach: Effects on the Quality of Translated Survey Texts

Exploring the Potential Role of Generative AI in the TRAPD Procedure for Survey Translation

Translation Quality and Error Recognition in Professional Neural Machine Translation Post-Editing

A Large-Scale Evaluation of Pre-editing Strategies for Improving User-Generated Content Translation

Questionnaires for Everyone: Streamlining Cross-Cultural Questionnaire Adaptation with GPT-Based Translation Quality Evaluation

Combining pre-editing and post-editing to improve SMT of user-generated content

CAT Tools Usability Test with Eye-Tracking and Key-Logging: Where Translation Studies Meets Natural Language Processing

Translating science fiction in a CAT tool: machine translation and segmentation settings

Post-editese: an Exacerbated Translationese

Identifying the Machine Translation Error Types with the Greatest Impact on Post-editing Effort

Performance and perception: machine translation post-editing in Chinese-English news translation by novice translators

Assessing Human Post-Editing Efforts to Compare the Performance of Three Machine Translation Engines for English to Russian Translation of Cochrane Plain Language Health Information: Results of a Randomised Comparison

Measuring translation revision competence and post-editing competence in translation trainees: methodological issues

Effects of pre-editing operations on audiovisual translation using TRADOS: an experimental analysis of Saudi students’ translations

A Study of Pre-editing Methods at the Lexical Level in the Process of Machine Translation

A review of the state-of-the-art in automatic post-editing

Joss Moorkens, Sheila Castilho, Federico Gaspari, Stephen Doherty (eds): Translation quality assessment: from principles to practice

Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts

Translation Quality Assessment: A Brief Survey on Manual and Automatic Methods

Exploring the Influence of CAT Tools on Domestication and Foreignization in Translation

Controlling Extra-Textual Attributes about Dialogue Participants -- A Case Study of English-to-Polish Neural Machine Translation