Abstract:Peer assessment (PA) is employed as one fundamental practice of classroom-based assessment in terms of its learning-oriented and formative nature. The exercise of peer assessment has multiple and additional benefits for student learning. However, research into the learning processes in peer assessment is scarce both in theory and in practice, making it difficult to evaluate and pinpoint its value as a tool in assessment as learning (AaL). This study focuses both on the learning process and outcome through assessment activities. We set out with three goals in mind: (1) to examine students' assessment performance in context, (2) to evaluate its impact on student progress, and (3) to illuminate teachers on organizing assessment activities. Three specific research questions are answered in this study: (1) How do student raters perform in the process of PA in an advanced English class? (2) To what extent do assessment activities influence the students' speaking ability? (3) What are students' perceptions of PA regarding its benefits and caveats? A total of 29 undergraduate students participated in two assessment activities on argumentative speaking. Many-Facet Rasch Model analysis was conducted to measure the rater effects both at the group level and the individual level. Bias/interaction analyses were performed to diagnose rater behavior in different contexts including the rating session, speaking session, and peer assessment vs. self-assessment. Questionnaire and semi-structured interview data were also collected to explore factors and strategies that could interfere with PA as AaL. Results show that students exhibited stable rating behavior and made progress in argumentative speaking in all dimensions, including delivery, organization, and language use. They are more stringent with themselves than with peers although there is one rare case with a bias against peers. Participants acknowledged the benefits of PA but also shared reasonable concerns in practice. This study validated the feasibility and the effectiveness of PA for student learning. Discussion on findings and guidelines for effective implementation of PA as AaL are provided.

A Study of Constructing and Validating an EBB Rating Scale for a Large-scale and Low-stakes English Oral Test of 8th Graders

Best Rating Scale Design Theory: Implications for Developing Questionnaires in Nursing and Health Sciences

A Comparison of EFL Raters' Essay-Rating Processes across Two Types of Rating Scales.

A Preliminary Study on Self-constructionals Scales (scs)of Chinese-Version

Constructing and validating a self-assessment scale for Chinese college English-major students’ feedback knowledge repertoire in EFL academic writing: Item response theory and factor analysis approaches

Developing a rating scale for integrated assessment of reading-into-writing skills

Assessing Spoken EFL Without a Common Rating Scale

Validating the Multi-Dimensional Structure of Self-Efficacy Beliefs in Peer Feedback for L2 Writing: A Bifactor-Exploratory Structural Equation Modeling Approach

Application of an Automated Essay Scoring engine to English writing assessment using Many-Facet Rasch Measurement

The Construction of the Rating Scales on the Knowledge, Attitude, and Practice of Geriatrics and Analysis of Its Reliability and Validity

Development and Validation of A Computer Adaptive Efl Test

STUDY OF SOURCES OF SCORE VARIABILITY IN PERFORMANCE ASSESSMENT USING MFRM : A CASE OF SPEAKING TESTIN PETS BAND3 ?

English Language Teachers’ Perceived Classroom Assessment Knowledge and Practice: Developing and Validating a Scale

A Validating Study on Consecutive Interpreting Test Using Many-facet Rasch Model

Development and validation of scales for speaking self-efficacy: Constructs, sources, and relations

Student evaluation of teaching quality in higher education: development of an instrument based on 10 Likert‐scales

Exploring cognitive behavioral aspects in educational psychology: A rigorous analysis of reliability and validity measures

Studies on the underexploited legumes, Indigofera linifolia and Sesbania bispinosa: nutrient composition and antinutritional factors.

Assessing L2 integrated writing self-efficacy: Development and validation of a scale

Assessment as Learning: How Does Peer Assessment Function in Students' Learning?

Adapting a self-efficacy scale to the task of teaching scientific reasoning: collecting evidence for its psychometric quality using Rasch measurement