Abstract:Problem: Self-reflection is a critical component of professional development and clinical practice, but medical students' ability to self-reflect is typically limited. While inadequate self-reflection impacts future clinical decision-making, it may also adversely impact current learning through an inability to identify learning-behavior deficits. This may be exacerbated by common use of multiple-choice questions (MCQ) where incorrect responses provide less insight than other measures for students, faculty, or academic support. To address this, an Error Reflection Method (ERM) was developed to help students focus on 'why' they got an MCQ wrong rather than 'what' they got wrong, thereby promoting self-reflection and a learning-focus on assessment. Understanding students' learning-behavior deficits could also enrich engagement with academic support services and guide curricular design. Intervention: The ERM is a list of 10 common types of exam errors that were either 'test-taking' (unwitting) errors or 'learning-behavior' errors that reflected learning deficits. The ERM is simple, transferable, and sustainable, allowing longitudinal and regular monitoring of individual and collective error-making to focus support and guide curricular development. Context: Undergraduate medical students at the Virginia Tech Carilion School of Medicine, USA, used the ERM in formative assessment review sessions in pre-clinical years to select an error type that best described the cause of each incorrect response. Impact: Initial findings suggest the ERM is robust and associated with improved student performance and curricular development. Analysis of 3,775 student-identified errors showed the error types in the ERM described 96% of errors students made. Learning-behavior errors were more common (76%), but surprisingly, 19% were test-taking errors, allowing academic support to focus on test-taking skills in a population previously thought of as consummate test-takers. The most common error type reported was 'the content looked familiar but I couldn't answer the question' (32%); which we suggest is consistent with shallow learning. This finding has helped steer recent curricular development toward active and applied learning techniques. Lessons Learned: By formally and regularly identifying learning deficits, students may be more capable of addressing them and improve summative exam performance. As well as focusing academic support, understanding common student errors has been useful in guiding curricular design and content delivery. Further potential of the ERM may be realized in faculty development and directing assessment culture toward a learning focus.

Opportunities for Self-Evaluation Increase Student Calibration in an Introductory Biology Course

Metacognitive Exam Preparation Assignments in an Introductory Biology Course Improve Exam Scores for Lower ACT Students Compared with Assignments that Focus on Terms

Understanding the processes, practices and influences of calibration on feedback literacy in higher education marking: A qualitative study

The Effect Of Meta-Knowledge On Students' Performance Evaluation

Opportunities for guiding development: insights from first-year life science majors' use of metacognition

Calibration in EFL Reading: Examining The Nature of Judgment of Confidence

Formative Self-Assessment College Classes Improves Self-Regulation and Retention in First/Second Year Community College Students

How Should I Study for the Exam? Self-Regulated Learning Strategies and Achievement in Introductory Biology

Fostering student agency and motivation: co-creation of a rubric for self-evaluation in an ungraded course

Prompting undergraduate students’ metacognition of learning: implementing ‘meta-learning’ assessment tasks in the biomedical sciences

Assigning Medical Students Learning Goals: Do They Do It, and What Happens When They Don't?

A Simple and Sustainable Exercise to Enhance Student Self-Reflection on Error-Making, Focus Support, and Guide Curricular Design

Examination of the Quality and Effectiveness of Peer Feedback and Self‐reflection Exercises Among Medical Students

Re-Examining Calibration: The Case of Question Answering

Differences is students' performance, (mis)calibration, and confidence judgments depending on their preferred sitting position in class

Imagining, designing, and interpreting experiments: Using quantitative assessment to improve instruction in scientific reasoning

Examining the Associations Between Calibration Accuracy and Executive Functions in Physical Education

An exploration of metacognitive practices in medical educators

Course-Based Undergraduate Research Experiences Spanning Two Semesters of Biology Impact Student Self-Efficacy but not Future Goals

Assessment of Learner Metacognition in a Professional Pharmacy Elective Course

Alignment of learning objectives, assessments, and active learning to promote critical thinking in a first-year medical physiology course: lessons learned