Abstract:Background: The Choosing Wisely campaign highlights the importance of clinical reasoning abilities for competent and reflective physicians. The principles of this campaign should be addressed in undergraduate medical education. Recent research suggests that answering questions on important steps in patient management promotes knowledge retention. It is less clear whether increasing the authenticity of educational material by the inclusion of videos further enhances learning outcome. Methods: In a prospective randomised controlled cross-over study, we assessed whether repeated video-based testing is more effective than repeated text-based testing in training students to choose appropriate diagnostic tests, arrive at correct diagnoses and identify advisable therapies. Following an entry exam, fourth-year undergraduate medical students attended 10 weekly computer-based seminars during which they studied patient case histories. Each case contained five key feature questions (items) on the diagnosis and treatment of the presented patient. Students were randomly allocated to read text cases (control condition) or watch videos (intervention), and assignment to either text or video was switched between groups every week. Using a within-subjects design, student performance on video-based and text-based items was assessed 13 weeks (exit exam) and 9 months (retention test) after the first day of term. The primary outcome was the within-subject difference in performance on video-based and text-based items in the exit exam. Results: Of 125 eligible students, 93 provided data for all three exams (response rate 74.4%). Percent scores were significantly higher for video-based than for text-based items in the exit exam (76.2 ± 19.4% vs. 72.4 ± 19.1%, p = 0.026) but not the retention test (69.2 ± 20.2% vs. 66.4 ± 20.3%, p = 0.108). An additional Bayesian analysis of this retention test suggested that video-based training is marginally more effective than text-based training in the long term (Bayes factor 2.36). Regardless of presentation format, student responses revealed a high prevalence of erroneous beliefs that, if applied to the clinical context, could place patients at risk. Conclusion: Repeated video-based key feature testing produces superior short-term learning outcome compared to text-based testing. Given the high prevalence of misconceptions, efforts to improve clinical reasoning training in medical education are warranted. The Choosing Wisely campaign lends itself to being part of this process.

Single-choice or multiple true false questions (Kprime):Direct comparison of online tests in pharmacology over one year (Preprint)

Comparison of Multiple-Choice Question Formats in a First Year Medical Physiology Course

Does Medical Students' Preference of Test Format (Computer-based vs. Paper-based) have an Influence on Performance?

How can we teach medical students to choose wisely? A randomised controlled cross-over study of video- versus text-based case scenarios

Comparison between MCQ, Extended matching questions (EMQ) and Script concordance test (SCT) for assessment among first-year medical students - A pilot study

[Online quizzes for practice and assessment of pharmacotherapeutic knowledge during clinical courses in medical school - a pilot study in the psychiatry and neurology courses]

Findings from the expert-novice paradigm on differential response behavior among multiple-choice items of a pedagogical content knowledge test – implications for test development

Analysis of testing with multiple choice versus open-ended questions: Outcome-based observations in an anatomy course

Application of a utility analysis to evaluate a novel assessment tool for clinically oriented physiology and pharmacology

Advantages and pitfalls in utilizing artificial intelligence for crafting medical examinations: a medical education pilot study with GPT-4

Patients don't come with multiple choice options: essay-based assessment in UME

Item analysis of multiple-choice questions in pharmacology among medical undergraduates

Caution with competitive gamification in medical education: unexpected results of a randomised cross-over study

Does Multiple Choice Have a Future in the Age of Generative AI? A Posttest-only RCT

Testing anatomy: Dissecting spatial and non-spatial knowledge in multiple-choice question assessment

Post-exam feedback with question rationales improves re-test performance of medical students on a multiple-choice exam

Learning clinical reasoning: how virtual patient case format and prior knowledge interact

Development of knowledge in basic sciences: a comparison of two medical curricula

Utility of a multimodal computer-based assessment format for assessment with a higher degree of reliability and validity

Answering questions in a co‐created formative exam question bank improves summative exam performance, while students perceive benefits from answering, authoring, and peer discussion: A mixed methods analysis of PeerWise

Using Multiple-Choice Questions to Assess Student Acquisition of Scientific Inquiry Skills and Enhance Laboratory Design and Outcomes