Abstract:ProblemClerkship grades contribute to a summative assessment culture in clerkships and can therefore interfere with students' learning. For example, by focusing on summative, tiered clerkship grades, students often discount accompanying feedback that could inform future learning. This case report seeks to explore whether an assessment system intervention which eliminated tiered grades and enhanced feedback was associated with changes in student perceptions of clerkship assessment and perceptions of the clinical learning environment. Intervention: In January 2019, our institution eliminated tiered clerkship grading (honors/pass/fail) for medical students during the core clerkship year and implemented pass/fail clerkship grading along with required twice weekly, work-based assessments for formative feedback. Context: In this single institution, cross-sectional survey study, we collected data from fourth-year medical students one year after an assessment system intervention. The intervention entailed changing from honors/pass/fail to pass/fail grading in all eight core clerkships and implementing an electronic system to record twice-weekly real-time formative work-based assessments. The survey queried student perceptions on the fairness and accuracy of grading and the clinical learning environment-including whether clerkships were mastery- or performance-oriented. We compared responses from students one year after the assessment intervention to those from the class one year before the intervention. Comparisons were made using unpaired, two-tailed t-tests or chi-squared tests as appropriate with Cohen's d for effect size estimation for score differences. Content analysis was used to analyze responses from two open-ended questions about feedback and grading. Impact: Survey response rates were similar before and after intervention (76% (127/168) vs. 72% (118/163), respectively) with no between-group differences in demographics. The after-intervention group showed statistically significant increases in the following factors: "grades are transparent and fair" (Cohen's d = 0.80), "students receive useful feedback" (d = 0.51), and "resident evaluation procedures are fair" (d = 0.40). After-intervention respondents perceived the clerkship learning environment to be more mastery-oriented (d = 0.52), less performance approach-oriented (d = 0.63), and less performance avoid-oriented (d = 0.49). There were no statistical differences in the factors "attending evaluation procedures are fair," "evaluations are accurate," "evaluations are biased," or "perception of stereotype threat." Open-ended questions revealed student recommendations to improve clerkship summary narratives, burden of work-based assessment, and in-person feedback. Lessons Learned: After an assessment system change to pass/fail grading with work-based assessments, we observed moderate to large improvements in student perceptions of clerkship grading and the mastery orientation of the learning environment. Our intervention did not improve perceptions around bias in assessment in clerkships. Other medical schools may consider similar interventions to begin to address student concerns with clerkship assessment and promote a more adaptive learning environment.

Frontline assessors' opinions about grading committees in a medicine clerkship

Structures and Processes of Grading Committees in Internal Medicine Clerkships: Results of a National Survey

Moving toward Mastery: Changes in Student Perceptions of Clerkship Assessment with Pass/Fail Grading and Enhanced Feedback

Design of a clinical competency committee to maximize formative feedback

Are Pre-clerkship Remediation, Grading, and Reporting Practices Equitable in the U.S.? A National Survey

The Required Written History and Physical is Alive, but Not Entirely Well, in Internal Medicine Clerkships

Medical student perceptions of assessments of clinical reasoning in a general surgery clerkship

Curriculum committees are a chance for medical students to drive educational change

Clerkship Grading and the U.S. Economy: What Medical Education Can Learn From America's Economic History

You Get What You Reward: A Qualitative Study Exploring Medical Student Engagement in 2 Different Assessment Systems

Evaluating a grading change at UCSD school of medicine: pass/fail grading is associated with decreased performance on preclinical exams but unchanged performance on USMLE step 1 scores

How Do I Match? A Survey Study on the Impact of Step 1 Becoming Pass/Fail

Relationship of pass/fail grading and curriculum structure with well-being among preclinical medical students: a multi-institutional study

Patients don't come with multiple choice options: essay-based assessment in UME

To Grade or Not to Grade (the Quiz): The Impact of Two Formative Assessment Grading Approaches on Summative Assessment Outcomes in an Integrated Pre-clinical Curriculum

Emergency Medicine Clerkship Grading Scheme, Grade, and Rank-List Distribution as Reported on Standardized Letters of Evaluation

Comparing Scoring Consistency of Large Language Models with Faculty for Formative Assessments in Medical Education

Describing the current landscape of pass/fail grading schemes within skills-based pharmacy curricula

R.I.M.E. and reason: multi-station OSCE enhancement to neutralize grade inflation

Competency-Based Medical Education in a Norm-Referenced World: A Root Cause Analysis of Challenges to the Competency-Based Paradigm in Medical School

Racial and Ethnic Bias in Medical School Clinical Grading: A Review