Abstract:Objectives This research project aims to determine the potential differential impact of two curricular approaches to teaching evidence-based medicine (EBM) on student performance on an EBM assignment administered during the first year of clerkship. A meaningful result would be any statistically significant difference in scores on the assignment given to measure student performance. Design In order to assess and compare student learning under the different curricula, the principal investigator and a team of five faculty members blinded to assignment date and other possibly identifying details used a modified version of the previously validated Fresno rubric to retrospectively grade 3 years’ worth of EBM assignments given to students in clerkship rotations 1–3 (n=481) during the Internal Medicine clerkship. Specifically, EBM performance in three separate student cohorts was examined. Setting The study took place at a large Midwestern medical school with nine campuses across the state of Indiana. Participants Study participants were 481 students who attended the medical school and completed the Internal Medicine clerkship between 2017 and 2019. Interventions Prior to the inception of this study, our institution had been teaching EBM within a discrete 2-month time period during medical students’ first year. During a large-scale curricular overhaul, the approach to teaching EBM was changed to a more scaffolded, integrated approach with sessions being taught over the course of 2 years. In this study, we assess the differential impact of these two approaches to teaching EBM in the first 2 years of medical school. Main outcome measures We used clerkship-level EBM assignment grades to determine whether there was a difference in performance between those students who experienced the old versus the new instructional model. Clerkship EBM assignments given to the students used identical questions each year in order to have a valid basis for comparison. Additionally, we analysed average student grades across the school on the EBM portion of step 1. Results Four hundred and eighty-one assignments were graded. Mean scores were compared for individual questions and cumulative scores using a one-way Welch Analysis of Variance test. Overall, students performed 0.99 of a point better on the assignment from year 1 (Y1), prior to EBM curriculum integration, to year 3 (Y3), subsequent to EBM integration (p≤0.001). Statistically significant improvement was seen on questions measuring students’ ability to formulate a clinical question and critically appraise medical evidence. Additionally, on the United States Medical Licensing Examination (USMLE) step 1, we found that student scores on the EBM portion of the examination improved from Y1 to Y3. Conclusions Results of this study suggest that taking a scaffolded, curriculum-integrated approach to EBM instruction during the preclinical years increases, or at the very least does not lessen, student retention of and ability to apply EBM concepts to patient care. Although it is difficult to fully attribute students’ retention and application of EBM concepts to the adoption of a curricular model focused on scaffolding and integration, the results of this study show that there are value-added educational effects to teaching EBM in this new format. Overall, this study provides a foundation for new research and practice seeking to improve EBM instruction. Trial registration number IRB approval (Protocol number 1907054875) was obtained for this study.

The effectiveness of a clinically integrated e-learning course in evidence-based medicine: a cluster randomised controlled trial

Effectiveness of an e-learning course in evidence-based medicine for foundation (internship) training

Harmonising evidence-based medicine teaching: a study of the outcomes of e-learning in five European countries

A clinically integrated curriculum in evidence-based medicine for just-in-time learning through on-the-job training: the EU-EBM project

An Effectiveness Evaluation of a Community-Based Course for Medical Students: a Randomized Controlled Trial in the Teaching of Epidemiology.

Two strategies to intensify evidence-based medicine education of undergraduate students: a randomised controlled trial

A randomised controlled trial of a blended learning education intervention for teaching evidence-based medicine

Effectiveness of education in evidence-based healthcare: the current state of outcome assessments and a framework for future evaluations

Teaching evidence based medicine literature searching skills to medical students during the clinical years - a protocol for a randomised controlled trial

The effectiveness of evidence‐based healthcare educational interventions on healthcare professionals' knowledge, skills, attitudes, professional practice and healthcare outcomes: Systematic review and meta‐analysis

An Integrated, Case-Based Approach to Teaching Medical Students How to Locate the Best Available Evidence for Clinical Care

Integrating evidence-based medicine skills into a medical school curriculum: a quantitative outcomes assessment

Enhancing utility and understanding of evidence based practice through undergraduate nurse education

[Impact of an elective course in evidence-based clinical decision-making on competencies and attitudes of medical students: A pilot study]

Effect of Teaching Evidence-Based Medicine in Medical Postgraduates

Evaluation of evidence-based nursing course

Effectiveness of evidence-based medicine training for undergraduate students at a Chinese Military Medical University: a self-controlled trial

Online eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction

The design, fate and impact of a hospital-wide training program in evidence-based medicine for physicians – an observational study

Teaching evidence-based medicine with electronic databases for preclinical education

Online supplementation for teaching evidence-based medicine: feasibility of a randomised-controlled trial