Abstract:This research would investigate the extent to which that second language writing performance scores were influenced by rater effect in large scale assessment in China. Writing samples were obtained from 2427(1491 females, 936 males)first grade students in Junior high school. The 54 raters in this study were all experienced specialists in the field of Teaching English as the second language. Each examinee was randomly scored by two raters. Each writing sample was scored according to five criterion:①Information, a 4-point scale was use to measure content;②Gracture, which is a 4-point scale used to evaluate the sentence; ③Mechanics, a 3-point scale is for the overall structure;④Length, a 2-point scale used to measure the number of words;and⑤Coherence, a 3-point scale u the expression. The MFRM analysis was completed using Facets software. Three facets were analyzed including persons, raters, and rating criteria based on Partial credit Model. The findings in this study indicated that①Raters differed in severity or leniency.②Some raters could not follow the rating scale consistently, while others could not stay close to their own scoring standard.③Raters could be able to maintain an constant level of severity across all the examinees, but not to all five criteria. ④There was no differential rater functioning related to the gender of examinees, which also means that the raters maintained a consistent severity or leniency across male and female examinees. MFRM study had a number of implications for rating issues in L2 writing assessment. Individual feedbacks can improve the efficiency of rater training to ensure objectivity and fairness of the writing performance assessment.

On the Inter-rater Reliability of Translation Tests of Above-medium Length for College Students

Rater Reliability of Translation Testing

Research on the Human-aided Auto-assessment for Translation Tests in College English

Errors in translation: A case study of Chinese into English translation

Cultivation of Translation Competence and Reform of Teaching Translation in Chinese Universities

AN INVESTIGATION OF SCORER RELIABILITY OF SELF AND PEER ASSESSMENT OF EFL WRITING AMONG CHINESE COLLEGE STUDENTS

Error Analysis of Inter-rater Reliability of the Second Language Writing Performance Assessment

An Empirical Study of Translation Errors

Item-based assessment of translation competence: Chimera of objectivity versus prospect of reliable measurement

Analysis of Translation Errors in English-Chinese Translation Practice

Evaluating Chinese College Students' English Compositions:Contrastive Perspectives between a Chinese English Rater and a Native English Rater

A Comparison of EFL Raters' Essay-Rating Processes across Two Types of Rating Scales.

RESEARCH ON TRANSLATION QUALITY SELF-EVALUATION IN THE TRANSLATION PROCESS: CONTENTS, CRITERIA AND SUPPORT

An Experimental Study on Portfolio Evaluation of Translation

Chinese version of course and professor evaluation:Reliability and validity

Effects of cooperative translation on Chinese EFL student levels of interest and self-efficacy in specialized English translation

The Reliability Analysis on College Students' Evaluation of Teaching Performance

Should translations be assessed holistically or through error analysis

Assessing Students' Translation Competence: Integrating China's Standards of English with Cognitive Diagnostic Assessment Approaches

Investigating Score Dependability in English/Chinese Interpreter Certification Performance Testing: A Generalizability Theory Approach

Language Skills in Translation Test