Abstract:ProblemClerkship grades contribute to a summative assessment culture in clerkships and can therefore interfere with students' learning. For example, by focusing on summative, tiered clerkship grades, students often discount accompanying feedback that could inform future learning. This case report seeks to explore whether an assessment system intervention which eliminated tiered grades and enhanced feedback was associated with changes in student perceptions of clerkship assessment and perceptions of the clinical learning environment. Intervention: In January 2019, our institution eliminated tiered clerkship grading (honors/pass/fail) for medical students during the core clerkship year and implemented pass/fail clerkship grading along with required twice weekly, work-based assessments for formative feedback. Context: In this single institution, cross-sectional survey study, we collected data from fourth-year medical students one year after an assessment system intervention. The intervention entailed changing from honors/pass/fail to pass/fail grading in all eight core clerkships and implementing an electronic system to record twice-weekly real-time formative work-based assessments. The survey queried student perceptions on the fairness and accuracy of grading and the clinical learning environment-including whether clerkships were mastery- or performance-oriented. We compared responses from students one year after the assessment intervention to those from the class one year before the intervention. Comparisons were made using unpaired, two-tailed t-tests or chi-squared tests as appropriate with Cohen's d for effect size estimation for score differences. Content analysis was used to analyze responses from two open-ended questions about feedback and grading. Impact: Survey response rates were similar before and after intervention (76% (127/168) vs. 72% (118/163), respectively) with no between-group differences in demographics. The after-intervention group showed statistically significant increases in the following factors: "grades are transparent and fair" (Cohen's d = 0.80), "students receive useful feedback" (d = 0.51), and "resident evaluation procedures are fair" (d = 0.40). After-intervention respondents perceived the clerkship learning environment to be more mastery-oriented (d = 0.52), less performance approach-oriented (d = 0.63), and less performance avoid-oriented (d = 0.49). There were no statistical differences in the factors "attending evaluation procedures are fair," "evaluations are accurate," "evaluations are biased," or "perception of stereotype threat." Open-ended questions revealed student recommendations to improve clerkship summary narratives, burden of work-based assessment, and in-person feedback. Lessons Learned: After an assessment system change to pass/fail grading with work-based assessments, we observed moderate to large improvements in student perceptions of clerkship grading and the mastery orientation of the learning environment. Our intervention did not improve perceptions around bias in assessment in clerkships. Other medical schools may consider similar interventions to begin to address student concerns with clerkship assessment and promote a more adaptive learning environment.

Why do instructors pass underperforming students? A Q-methodology study

The Effect Of Meta-Knowledge On Students' Performance Evaluation

Classification of the Factors of Academic Difficulties Experienced by Underachieving Engineering Students: An Application of Q Methodology

Failure to fail - Perspective from junior faculty preceptors on the challenges of evaluating underperforming students in the experiential learning environment

Course evaluation scores: valid measures for teaching effectiveness or rewards for lenient grading?

A Q-methodology study of the type of support mentors need when assessing underperforming nursing students

Moving toward Mastery: Changes in Student Perceptions of Clerkship Assessment with Pass/Fail Grading and Enhanced Feedback

Interactive Learning with Student Response System to Encourage Students to Provide Peer Feedback

Pondering zeros: analysis of a decade of blanks and missed quizzes

Stuck in Place? A Field Experiment on the Effects of Reputational Information on Student Evaluations

Management by results: Student evaluation of faculty teaching and the mis-measurement of performance

Identifying key factors of student academic performance by subgroup discovery

Design, Experimentation and Statistical Validation of a Methodology to Solve Complex Engineering Problems in Higher Education

Grading Teacher Performance Appraisal Systems: Understanding the Implications of Student Test Scores and Performance Information Use

Barriers to obtaining reliable results from evaluations of teaching quality in undergraduate medical education

Investigating the Essential of Meaningful Automated Formative Feedback for Programming Assignments

Sexism, racism, prejudice, and bias: a literature review and synthesis of research surrounding student evaluations of courses and teaching

The impact of teacher feedback on students' decisions to stay on or change course after math failure in a Confucian cultural context

Lecturing and other face-to-face teaching – too much or too little? An assessment based on student feedback and fail rates

A phenomenological exploration of the feedback experience of medical students after summative exam failure

Transforming the Lowest-Performing Students: An Intervention that Worked.