Association of a Gamified Journal Club on Internal Medicine Residents' Engagement and Critical Appraisal Skills

Steven Allon,Alan Baggett,Benjamin Hayes,Katherine Glosemeyer,Jose Cavo,Rami Pacha,Joanna Zurko,Nidhip Patel,Ryan Kraemer

DOI: https://doi.org/10.4300/JGME-D-22-00812.1

Abstract:Background: Prior literature demonstrates internal medicine residents have suboptimal competence in critical appraisal. Journal clubs are a common intervention to address this skill, but engagement and critical appraisal skill improvement are variable. Objective: We evaluated journal club engagement and critical appraisal skills after implementation of a gamified format. Methods: This was a single-arm study, conducted from July 1, 2020 to June 30, 2021, involving internal medicine residents at 2 US programs. Residents participated in a 12-month gamified journal club that sorted residents into 2 teams. Residents attended an orientation followed by 6 to 10 monthly, hour-long competitions. In each competition, a subset of the resident teams competed to answer a clinical prompt by critically appraising an original article of their choice. A chief medical resident or faculty member moderated each session and chose the winning team, which received a nominal prize of candy. The primary outcome was engagement, measured by a 7-question survey developed de novo by the authors with Likert scale responses at baseline and 12 months. The secondary outcome was critical appraisal skills assessed by the Berlin Questionnaire. Results: Sixty-one of 72 eligible residents (84.7%) completed both engagement surveys. Residents reported statistically significant improvements in most dimensions of engagement, including a higher likelihood of reading articles before sessions (posttest minus pretest score -1.08; 95% CI -1.34 to -0.82; P<.001) and valuing time spent (posttest minus pretest score -0.33; 95% CI -0.55 to -0.11; P=.004). Critical appraisal skills marginally improved at 12 months (posttest minus pretest score -0.84; 95% CI -1.54 to -0.14; P=.02). Conclusions: Our study demonstrates a gamified journal club was associated with improvements in engagement and minimal change in critical appraisal skills.