Abstract:Problem: Self-reflection is a critical component of professional development and clinical practice, but medical students' ability to self-reflect is typically limited. While inadequate self-reflection impacts future clinical decision-making, it may also adversely impact current learning through an inability to identify learning-behavior deficits. This may be exacerbated by common use of multiple-choice questions (MCQ) where incorrect responses provide less insight than other measures for students, faculty, or academic support. To address this, an Error Reflection Method (ERM) was developed to help students focus on 'why' they got an MCQ wrong rather than 'what' they got wrong, thereby promoting self-reflection and a learning-focus on assessment. Understanding students' learning-behavior deficits could also enrich engagement with academic support services and guide curricular design. Intervention: The ERM is a list of 10 common types of exam errors that were either 'test-taking' (unwitting) errors or 'learning-behavior' errors that reflected learning deficits. The ERM is simple, transferable, and sustainable, allowing longitudinal and regular monitoring of individual and collective error-making to focus support and guide curricular development. Context: Undergraduate medical students at the Virginia Tech Carilion School of Medicine, USA, used the ERM in formative assessment review sessions in pre-clinical years to select an error type that best described the cause of each incorrect response. Impact: Initial findings suggest the ERM is robust and associated with improved student performance and curricular development. Analysis of 3,775 student-identified errors showed the error types in the ERM described 96% of errors students made. Learning-behavior errors were more common (76%), but surprisingly, 19% were test-taking errors, allowing academic support to focus on test-taking skills in a population previously thought of as consummate test-takers. The most common error type reported was 'the content looked familiar but I couldn't answer the question' (32%); which we suggest is consistent with shallow learning. This finding has helped steer recent curricular development toward active and applied learning techniques. Lessons Learned: By formally and regularly identifying learning deficits, students may be more capable of addressing them and improve summative exam performance. As well as focusing academic support, understanding common student errors has been useful in guiding curricular design and content delivery. Further potential of the ERM may be realized in faculty development and directing assessment culture toward a learning focus.

Using Clickers to Address Common Errors and Misconceptions in Statistics

Clickers in the Biology Classroom: Strategies for Writing and Effectively Implementing Clicker Questions That Maximize Student Learning

Revisiting Clickers: In-Class Questions Followed by At-Home Reflections Are Associated with Higher Student Performance on Related Exam Questions

A Campus-Wide Investigation of Clicker Implementation: The Status of Peer Discussion in STEM Classes

Higher-Order Clicker Questions Engage Students and Prepare Them for Higher-Order Thinking Activities

Using Astronomical Photographs to Investigate Misconceptions about Galaxies and Spectra: Question Development for Clicker Use

The Effects of Clickers With Different Teaching Strategies

Peer Instruction: Comparing Clickers to Flashcards

Evidence for teaching practice: The impact of clickers in a large classroom environment

Effectiveness of the use of clickers versus group discussion in learning by undergraduate medical students

Socratic Dialogs and Clicker use in an Upper-Division Mechanics Course

Using Targeted Feedback to Address Common Student Misconceptions in Introductory Programming: A Data-Driven Approach

An open-access clicker question bank for numerical analysis

THE IMPACT OF THE USE OF CLICKER TOOLS IN ACADEMIC CLASSROOM ENVIRONMENTS

A comparative study: do “clickers” increase student engagement in multidisciplinary clinical microbiology teaching?

Uncovering student errors in measures of dispersion: An APOS theory analysis in high school statistics education

Using clickers to facilitate interactive engagement activities in a lecture room for improved performance by students

Click-level Learning Analytics in an Online Medical Education Learning Platform

Is Class Appreciation Just a Click Away?: Using Student Response System Technology to Enhance Shy Students' Introductory American Government Experience

The impact of clickers instruction on cognitive loads and listening and speaking skills in college English class

A Simple and Sustainable Exercise to Enhance Student Self-Reflection on Error-Making, Focus Support, and Guide Curricular Design