Abstract:Problem: Self-reflection is a critical component of professional development and clinical practice, but medical students' ability to self-reflect is typically limited. While inadequate self-reflection impacts future clinical decision-making, it may also adversely impact current learning through an inability to identify learning-behavior deficits. This may be exacerbated by common use of multiple-choice questions (MCQ) where incorrect responses provide less insight than other measures for students, faculty, or academic support. To address this, an Error Reflection Method (ERM) was developed to help students focus on 'why' they got an MCQ wrong rather than 'what' they got wrong, thereby promoting self-reflection and a learning-focus on assessment. Understanding students' learning-behavior deficits could also enrich engagement with academic support services and guide curricular design. Intervention: The ERM is a list of 10 common types of exam errors that were either 'test-taking' (unwitting) errors or 'learning-behavior' errors that reflected learning deficits. The ERM is simple, transferable, and sustainable, allowing longitudinal and regular monitoring of individual and collective error-making to focus support and guide curricular development. Context: Undergraduate medical students at the Virginia Tech Carilion School of Medicine, USA, used the ERM in formative assessment review sessions in pre-clinical years to select an error type that best described the cause of each incorrect response. Impact: Initial findings suggest the ERM is robust and associated with improved student performance and curricular development. Analysis of 3,775 student-identified errors showed the error types in the ERM described 96% of errors students made. Learning-behavior errors were more common (76%), but surprisingly, 19% were test-taking errors, allowing academic support to focus on test-taking skills in a population previously thought of as consummate test-takers. The most common error type reported was 'the content looked familiar but I couldn't answer the question' (32%); which we suggest is consistent with shallow learning. This finding has helped steer recent curricular development toward active and applied learning techniques. Lessons Learned: By formally and regularly identifying learning deficits, students may be more capable of addressing them and improve summative exam performance. As well as focusing academic support, understanding common student errors has been useful in guiding curricular design and content delivery. Further potential of the ERM may be realized in faculty development and directing assessment culture toward a learning focus.

Better Being Wrong (Sometimes): Classroom Assessment that Enhances Student Learning and Motivation

Positive error climate promotes learning outcomes through students’ adaptive reactions towards errors

Learning from errors in mathematics classrooms: Development over 2 years in dependence of perceived error climate

Teacher Assessment and Teacher Change in Classroom Communication Behaviors

Assessment, feedback and the alchemy of learning

Error Matters: An Initial Exploration of Elementary School Children's Understanding of Experimental Error

The role of momentary emotions in promoting error learning orientation among lower secondary school students: An intervention study embedded in a short visual programming course

Contrasting stances at the crossroads of debugging learning opportunities

Formative Assessment in a Geology Classroom: Promoting Learning by Giving Top Marks

Learning from errors versus explicit instruction in preparation for a test that counts

Rethinking authentic assessment: work, well-being, and society

Philosophical Considerations on Errors in Teaching and Learning

Towards fostering growth mindset classrooms: identifying teaching behaviors that signal instructors’ fixed and growth mindsets beliefs to students

Effects on and consequences of responses to errors: Results from two experimental studies

Is using the term wellbeing with students a mistake? Evaluating a wellbeing intervention in a UK Law School - suggestions for repositioning strategies to address the impact of deficit-discourse

Learning Mathematics through incorrect Problems

Exploring the Emotional Responses of Undergraduate Students to Assessment Feedback: Implications for Instructors

A Simple and Sustainable Exercise to Enhance Student Self-Reflection on Error-Making, Focus Support, and Guide Curricular Design

The Role of Metacognition in Enhancing Learning

Assessing Confidence and Certainty of Students in an Undergraduate Linear Algebra Course

From High School to College Calculus: Beliefs about Sense-Making and Mistakes