Abstract:Translation and paraphrasing, as typical forms in second language (L2) communication, have been considered effective learning methods in second language acquisition (SLA). While many studies have investigated their similarities and differences in a process-oriented approach, little attention has been paid to the correlation in product quality between them, probably due to difficulties in assessing the quality of translation and paraphrasing. Current quality evaluation methods tend to be either subjective and one-sided or lack consistency and standardization. To address these limitations, we proposed preliminary evaluation frameworks for translation and paraphrasing by incorporating indices from natural language processing (NLP) tools into teachers' rating rubrics and further compared the product quality of the two activities. Twenty-nine translators were recruited to perform a translation task (translating from Chinese to English) and a paraphrasing task (paraphrasing in English). Their output products were recorded by key-logging technique and graded by three professional translation teachers by using a 10-point Likert Scale. This rating process adopted rubrics consisting of both holistic and analytical assessments. Besides, indices containing textual features from lexical and syntactic levels were extracted from TAASSC and TAALES. We identified indices that effectively predicted product quality using Pearson's correlation analysis and combined them with expert evaluation rubrics to establish NLP-assisted evaluation frameworks for translation and paraphrasing. With the help of these frameworks, we found a closely related performance between the two tasks, evidenced by several shared predictive indices in lexical sophistication and strong positive correlations between translated and paraphrased text quality according to all the rating metrics. These similarities suggest a shared language competence and mental strategies in different types of translation activities and perhaps in other forms of language tasks. Meanwhile, we also observed differences in the most salient textual features between translations and paraphrases, mainly due to the different processing costs required by the two tasks. These findings enrich our understanding of the shared ground and divergences in product quality between translation and paraphrasing and shed light on the pedagogical application of translation activities in classroom teaching. Moreover, the proposed evaluation framework can also bring insights into the development of standardized evaluation frameworks in translation and paraphrasing in the future.

Joss Moorkens, Sheila Castilho, Federico Gaspari, Stephen Doherty (eds): Translation quality assessment: from principles to practice

Book Review: Translation Quality Assessment: From Principles to Practice

Translation quality assessment: a critical methodological review

Evaluating the evaluator: A novel perspective on translation quality

Translation Quality Assessment: A Brief Survey on Manual and Automatic Methods

A new deal for translation quality

A Bayesian approach to translators' reliability assessment

Translation Quality Evaluation

Positions, Power and Practice: Functionalist Approaches and Translation Quality Assessment

Measuring Uncertainty in Translation Quality Evaluation (TQE)

Machine translation systems and quality assessment: a systematic review

Data-driven Asian Adapted MQM Typology and Automation in Translation Quality Workflows

The Multi-Range Theory of Translation Quality Measurement: MQM scoring models and Statistical Quality Control

A Review of Translation Quality Assessment: Achievements, Problems and Methods

Multidimensional Quality Metrics (MQM)

Can Automatic Metrics Assess High-Quality Translations?

Comparing product quality between translation and paraphrasing: Using NLP-assisted evaluation frameworks

Pushing the Right Buttons: Adversarial Evaluation of Quality Estimation

An Evaluation of Translation Quality Assessment Course: Voices from Instructors

An Interpretive Study of Six Major Models towards Translation Quality Assessments

Translation Methodology in the Spoken Language Translator: An Evaluation