Evaluating Clinical Reasoning in Undergraduate Medical Education: The Value of a Virtual Oral Assessment

Michelle Jeffery,A Reema Kar,Archana Pradhan,Samantha Brannigan,Carol Terregino,Hanin Rashid,Rick Salisbury,Conrad Johnson,Sugeet Jagpal

DOI: https://doi.org/10.1177/00031348241250049

Abstract:Background: Oral assessments are essential components of board certification in numerous fields, as they provide insight into problem-solving capacity and clinical reasoning. The development of clinical reasoning often begins in undergraduate medical education and remains a challenge to assess. Objective: We developed a pilot oral assessment to evaluate medical student oral presentations and systematically assess clinical reasoning. This was incorporated into a previously existing cumulative assessment at the conclusion of the third year of medical school, with the intent to demonstrate feasibility and future reliability of this exam format. Methods: This pilot oral assessment was developed using content taught during third year clerkships. A modified Assessment of Reasoning Tool (ART) was used as the evaluation metric. It was conducted virtually to include faculty members from multiple disciplines and accommodate schedules and space limitations. Results: A total of 152 third year medical students completed the exam, with a total of 15 faculty examiners. 89% of medical students scored as complete in hypothesis directed history, 93% in problem representation, 86% in prioritized differential diagnoses, and 67% in effectively directing management. Most examiners felt an oral assessment is effective to determine a medical student's clinical reasoning ability. Conclusions: Virtual oral assessments of clinical reasoning can be incorporated in undergraduate medical education to identify students struggling with components of clinical reasoning, while also allowing maximum flexibility for the clinician educator workforce as examiners. Longitudinal use of these exams would be valuable to track the development of clinical reasoning across the medical school curriculum.