A Little Fun, A Big Impact - Gamification Doubles the Number of Procedures Logged by Emergency Medicine Residents

Natalie Diers,Stephanie Cohen,Maria Tassone,Shayne Gue

DOI: https://doi.org/10.5811/westjem.20516

2024-03-26

Western Journal of Emergency Medicine

Abstract:Author(s): Diers, Natalie; Cohen, Stephanie; Tassone, Maria; Gue, Shayne

emergency medicine

What problem does this paper attempt to address?

Gamification of graduate medical education in an emergency medicine residency program

Shayne Gue,Joseph Ray,Latha Ganti

DOI: https://doi.org/10.1186/s12245-022-00445-1

2022-08-30

Abstract:Objectives: Our program implemented East EMWars, a year-long, longitudinal game that added competition to our existing curricular content. We surveyed residents to investigate the impact of gamification in emergency medicine residency training. We hypothesized that residents would report higher levels of motivation, engagement, and challenge with gamification compared to traditional didactics. Furthermore, we hypothesized that residents would exhibit generally positive perceptions about gamification as a learning tool and that it would translate to improved performance on the annual in-training examination. Methods: This was a single-center, prospective pre- and post-intervention survey study at a community-based emergency medicine residency program. Given the multiplicity of research questions and inherent nature of educational research, a mixed methods approach was utilized. We utilized nonparametric testing for quantitative data with paired responses pre- and post-intervention. We solicited comments on the post-intervention that were categorized under thematic approach and presented in complete and unedited form in the results. Results: Eighteen (100%) of eligible residents in our program participated in both surveys. There were statistically significant increases in reported levels of motivation, engagement, and challenge with gamification compared to traditional didactic methods. Residents also reported overwhelmingly positive general perceptions about gamification and its broader generalizability and applicability. We did not reach statistical significance in determining if in-training exam scores were associated with our gamification initiative. Conclusions: This study was a first-of-its-kind look into a longitudinal game in an emergency medicine residency program. Although our results are encouraging, medical educators need further research to determine if this increase in motivation, engagement, and challenge will be associated with an increase in examination scores or, more importantly, healthcare outcomes. Theory-based, broader-scale, prospective studies are needed to further explore and help establish these associations and outcomes.
Escape the Monotony: Gamification Enhances Nursing Education

Aminda Seymour,Morgan Borggren,Rachel Baker

DOI: https://doi.org/10.1016/j.jen.2023.06.004

Abstract:Introduction: Creating meaningful and engaging learning opportunities can be challenged by budgets, time, and learning management systems with limited methods of interaction. An innovative method was necessary to meet competency evaluation and continuing education needs for emergency department staff. Design: Gamification and simulation techniques were combined to offer an interactive learning opportunity through an escape room format to improve engagement and knowledge retention. This educational offering was designed to enhance staff learning of trauma care and processes at emergency departments that are not designated trauma centers. Outcomes: Emergency department team members completed the trauma escape room challenge, and postsurvey results demonstrated favorable ratings of new knowledge acquisition, skill competency, teamwork, and confidence when providing care for a trauma patient. Discussion: Nurse educators can "escape" the monotony of passive learning by using active learning strategies including the fun of gamification to improve clinical skills and confidence.
Gamification of emergency medicine cost awareness education

Joseph Ray

DOI: https://doi.org/10.1002/aet2.11008

2024-06-20

Abstract:Background: Despite rising costs of health care, physician awareness of costs remains poor. Educational initiatives to remedy this have shown promise, with gamification specifically having success, but actual improvements in physician estimation capabilities have yet to be evaluated. Objectives: The objective of the study was to assess a gamified educational session for emergency medicine residents that improved their ability to estimate the costs of tests or services commonly performed in their department. Methods: Participants completed an anonymous presession survey consisting of demographic data, self-analysis on cost awareness, and a 10-item cost estimation list. This was followed by a 1-h interactive gamified education session utilizing rules from the television show The Price is Right. During this session, only three of the survey items had their cost directly discussed such that the remaining seven were able to be assessed solely on estimation improvement instead of short-term knowledge retention. Participants then completed the same survey to assess for improvement in cost awareness. Results: Sixteen residents at the PGY-2 or PGY-3 level completed the surveys and education session. All self-analysis questions showed significant improvement in the postsession survey. Eight out of the 10 items had significant differences in cost estimation. Conclusions: A gamified teaching session using The Price is Right rules can improve a resident's estimation capabilities, even on items not directly taught during the session.
Enhancing triage accuracy in emergency nurses: The impact of a game-based triage educational app

Sun-Hee Moon,Su Ol Kim

DOI: https://doi.org/10.1016/j.ienj.2023.101398

IF: 2.613

2024-01-11

International Emergency Nursing

Abstract:Introduction Digital technology has enabled gamification methods to enhance triage education, reflecting an evolving healthcare landscape. Objective To evaluate the effectiveness of a Gamification Triage Education App (GTEA) as a learning tool for emergency nurses, with a focus on creating an engaging and educationally effective platform for triage training. Method The GTEA was developed using no-code based software and expanded upon previous iterations, with added features such as points, rankings, instant feedback, and quest-based stories. From December 2021 to March 2022, 27 emergency room nurses from three hospitals in Korea were instructed to use GTEA for 100 min over the course of a week. The effects were measured before and after the intervention. Results The results demonstrated a significant increase in triage accuracy from 4.3 ± 2.00 to 5.33 ± 1.47 (t = −2.18, p = 0.039), along with a substantial reduction in overtriage (t = 3.11, p = 0.004). Additionally, increases in critical thinking disposition, triage competency, and triage knowledge were observed (t = −3.11, p = 0.004; t = −2.72, p = 0.011; t = −3.14, p = 0.004, respectively). Conclusions The findings provide robust evidence for the effectiveness of gamification in triage training within emergency nursing.

nursing
Emergency Medicine Obstetrics and Gynecology: A Case-Based Curriculum for Residents

Shannon M Burke,Thaddeus Schmitt,Polly Kennedy,Brittany Kotek,James N Wolfe,Corlin Jewell,Kaitlin A Ray,Benjamin H Schnapp

DOI: https://doi.org/10.15766/mep_2374-8265.11330

2023-08-11

MedEdPORTAL

Abstract:Introduction: Millions of patients present to US emergency departments every year with OB/GYN concerns. Emergency medicine trainees must be adequately prepared to care for this population, regardless of how commonly they appear in the training environment. We used active learning and gamification principles in this curriculum to increase learner engagement and participation in the material. Methods: We chose OB/GYN topics based on review of Tintinalli's OB/GYN content and the American Board of Emergency Medicine's Model of Clinical Practice. Each session comprised a case-based lecture and review questions using the game-based Kahoot! online software. Pre- and postcurriculum surveys assessed residents' confidence in caring for emergent OB/GYN pathologies on a 5-point Likert scale. We designed survey questions assessing the first level of Kirkpatrick's levels of training evaluation; these questions were reviewed and revised by the department's Medical Education Scholarship Committee for validity. Results: A mean of 18 residents attended each session. Seventy-six percent of residents (26 of 34) completed the precurriculum survey, 67% (23 of 34) completed the postcurriculum survey, and 44% (15 of 34) completed both. For all respondents, mean reported confidence with curriculum topics increased from 3.5 to 4.0 (p < .05). For residents completing both surveys, confidence increased from 3.4 to 4.0 (p < .01). Discussion: Application of this curriculum significantly improved learner confidence in targeted OB/GYN topics. Future directions could include evaluating curricular impact at higher levels in the Kirkpatrick model, extending sessions to include more time for interaction, and adding suggested readings.
Disaster day: a simulation-based competition for educating emergency medicine residents and medical students on disaster medicine

Shayne Gue,Stephanie Cohen,Maria Tassone,Ayanna Walker,Andy Little,Martin Morales-Cruz,Casey McGillicuddy,David Lebowitz,Robert Pell,Ariel Vera,Steven Nazario,Darielys Mejias,Andrew Bobbett,Drake Dixon,Anines Quinones,Latha Ganti

DOI: https://doi.org/10.1186/s12245-023-00520-1

2023-09-15

International Journal of Emergency Medicine

Abstract:Disaster medicine is a growing field within the specialty of emergency medicine, but educational training typically focuses on hospital drills or other educational strategies, such as didactics, simulation, or tabletop exercises. With the success of gamification in other medical education applications, we sought to investigate if a novel gamified curricular innovation would lead to improved test performance and confidence in the ability to manage a real mass casualty incident (MCI).
Trapped as a Group, Escape as a Team: Applying Gamification to Incorporate Team-building Skills Through an ‘Escape Room’ Experience

Xiao Chi Zhang,Hyunjoo Lee,Carlos Rodriguez,Joshua Rudner,Teresa M Chan,Dimitrios Papanagnou

DOI: https://doi.org/10.7759/cureus.2256

2018-03-02

Cureus

Abstract:Teamwork, a skill critical for quality patient care, is recognized as a core competency by the Accreditation Council for Graduate Medical Education (ACGME). To date, there is no consensus on how to effectively teach these skills in a forum that engages learners, immerses members in life-like activities, and builds both trust and rapport. Recreational 'Escape Rooms' have gained popularity in creating a life-like environment that rewards players for working together, solving puzzles, and completing successions of mind-bending tasks in order to effectively 'escape the room' in the time allotted. In this regard, escape rooms share many parallels with the multitasking and teamwork that is essential for a successful emergency department (ED) shift. A pilot group of nine emergency medicine (EM) residents and one senior EM faculty member underwent a commercial escape room as part of a team-building exercise in January 2018. The escape room required participants to practice teamwork, communication, task delegation, and critical thinking to tackle waves of increasingly complex puzzles, ranging from hidden objects, physical object assembly (i.e., jigsaw puzzles), and symbol matching. Activities required members to recognize and utilize the collective experiences, skills, knowledge base, and physical abilities of the group. After the game, players underwent a structured 'game-master' debriefing facilitated by an employee of the commercial escape room; this was followed by a post-event survey facilitated by a faculty member, which focused on participants' feelings, experiences, and problem-solving techniques. Escape rooms afford learners the opportunity to engage in an activity that rewards teamwork and effective leadership through experiences that directly link to specific ACGME milestones and educational learning theories. EM participants were engaged in the activity and felt that the escape room reproduced an environment analogous to the ED. The debriefing that followed the activity provided a satisfactory conclusion to the experience; but learners preferred a more organized debriefing format that provided them with constructive and specific feedback on their performance.
How Many Lives Will You Save? A Mixed Methods Evaluation of a Novel, Online Game for Patient Safety and Quality Improvement Education

Gabriela Ruiz Colón,Kambria Evans,Mia Kanzawa,Anuradha Phadke,Laurence Katznelson,Lisa Shieh

DOI: https://doi.org/10.1097/jmq.0000000000000153

2023-10-28

American Journal of Medical Quality

Abstract:Medical trainees have limited knowledge of quality improvement and patient safety concepts. The authors developed a free quality improvement/patient safety educational game entitled Safety Quest (SQ). However, 1803 undergraduate medical trainees, graduate medical trainees, and continuing medical education learners globally completed at least 1 level of SQ. Pre- and post-SQ knowledge and satisfaction were assessed among continuing medical education learners. Thematic analysis of feedback given by trainees was conducted. Among graduate medical trainees, SQ outranked other learning modalities. Three content areas emerged from feedback: engagement, ease of use, and effectiveness; 87% of comments addressing engagement were positive. After completing SQ, 98.6% of learners passed the post-test, versus 59.2% for the pretest ( P < 0.0001). Ninety-three percent of learners agreed that SQ was engaging and interactive, and 92% believed it contributed to their professional growth. With an increased need for educational curricula to be delivered virtually, gamification emerges as a unique strategy that learners praise as engaging and effective.

health care sciences & services
Association of a Gamified Journal Club on Internal Medicine Residents' Engagement and Critical Appraisal Skills

Steven Allon,Alan Baggett,Benjamin Hayes,Katherine Glosemeyer,Jose Cavo,Rami Pacha,Joanna Zurko,Nidhip Patel,Ryan Kraemer

DOI: https://doi.org/10.4300/JGME-D-22-00812.1

Abstract:Background: Prior literature demonstrates internal medicine residents have suboptimal competence in critical appraisal. Journal clubs are a common intervention to address this skill, but engagement and critical appraisal skill improvement are variable. Objective: We evaluated journal club engagement and critical appraisal skills after implementation of a gamified format. Methods: This was a single-arm study, conducted from July 1, 2020 to June 30, 2021, involving internal medicine residents at 2 US programs. Residents participated in a 12-month gamified journal club that sorted residents into 2 teams. Residents attended an orientation followed by 6 to 10 monthly, hour-long competitions. In each competition, a subset of the resident teams competed to answer a clinical prompt by critically appraising an original article of their choice. A chief medical resident or faculty member moderated each session and chose the winning team, which received a nominal prize of candy. The primary outcome was engagement, measured by a 7-question survey developed de novo by the authors with Likert scale responses at baseline and 12 months. The secondary outcome was critical appraisal skills assessed by the Berlin Questionnaire. Results: Sixty-one of 72 eligible residents (84.7%) completed both engagement surveys. Residents reported statistically significant improvements in most dimensions of engagement, including a higher likelihood of reading articles before sessions (posttest minus pretest score -1.08; 95% CI -1.34 to -0.82; P<.001) and valuing time spent (posttest minus pretest score -0.33; 95% CI -0.55 to -0.11; P=.004). Critical appraisal skills marginally improved at 12 months (posttest minus pretest score -0.84; 95% CI -1.54 to -0.14; P=.02). Conclusions: Our study demonstrates a gamified journal club was associated with improvements in engagement and minimal change in critical appraisal skills.
Effectiveness of gamified team competition as mHealth intervention for medical interns: a cluster micro-randomized trial

Jitao Wang,Yu Fang,Elena Frank,Maureen A. Walton,Margit Burmeister,Ambuj Tewari,Walter Dempsey,Timothy NeCamp,Srijan Sen,Zhenke Wu

DOI: https://doi.org/10.1038/s41746-022-00746-y

IF: 15.2

2023-01-12

npj Digital Medicine

Abstract:Gamification, the application of gaming elements to increase enjoyment and engagement, has the potential to improve the effectiveness of digital health interventions, while the effectiveness of competition gamification components remains poorly understood on residency. To address this gap, we evaluate the effect of smartphone-based gamified team competition intervention on daily step count and sleep duration via a micro-randomized trial on medical interns. Our aim is to assess potential improvements in the factors (namely step count and sleep) that may help interns cope with stress and improve well-being. In 1779 interns, team competition intervention significantly increases the mean daily step count by 105.8 steps (SE 35.8, p = 0.03) relative to the no competition arm, while does not significantly affect the mean daily sleep minutes ( p = 0.76). Moderator analyses indicate that the causal effects of competition on daily step count and sleep minutes decreased by 14.5 steps (SE 10.2, p = 0.16) and 1.9 minutes (SE 0.6, p = 0.003) for each additional week-in-study, respectively. Intra-institutional competition negatively moderates the causal effect of competition upon daily step count by −90.3 steps (SE 86.5, p = 0.30). Our results show that gamified team competition delivered via mobile app significantly increases daily physical activity which suggests that team competition can function as a mobile health intervention tool to increase short-term physical activity levels for medical interns. Future improvements in strategies of forming competition opponents and introducing occasional competition breaks may improve the overall effectiveness.

health care sciences & services,medical informatics
Using Gamified Sim for Annual Education

Alexis Isbell,Teresa Williams,Stephanie Tran

DOI: https://doi.org/10.1016/j.jogn.2024.05.016

2024-06-21

Abstract:Low volume, high-risk situations often require refresher training for health care providers to ensure the team is prepared. Obstetric hemorrhage and hypertension are two occurrences that all nursing staff who encounter perinatal patients need to be confident in managing. The use of gamified simulation provides an engaging mechanism for staff to remain confident in their skills in managing these high-risk situations.

nursing,obstetrics & gynecology
Physician Trainee Procedure Logging via Electronic Health Records

Brian Kwan,Jeffery Engel,Brian Steele,Leslie Oyama,Christopher A. Longhurst,Robert El–Kareh,Michelle Daniel,Charles Goldberg,Brian Clay

DOI: https://doi.org/10.1001/jamanetworkopen.2023.52370

2024-01-25

JAMA Network Open

Abstract:Importance Procedural proficiency is a core competency for graduate medical education; however, procedural reporting often relies on manual workflows that are duplicative and generate data whose validity and accuracy are difficult to assess. Failure to accurately gather these data can impede learner progression, delay procedures, and negatively impact patient safety. Objective To examine accuracy and procedure logging completeness of a system that extracts procedural data from an electronic health record system and uploads these data securely to an application used by many residency programs for accreditation. Design, Setting, and Participants This quality improvement study of all emergency medicine resident physicians at University of California, San Diego Health was performed from May 23, 2023, to June 25, 2023. Exposures Automated system for procedure data extraction and upload to a residency management software application. Main Outcomes and Measures The number of procedures captured by the automated system when running silently compared with manually logged procedures in the same timeframe, as well as accuracy of the data upload. Results Forty-seven residents participated in the initial silent assessment of the extraction component of the system. During a 1-year period (May 23, 2022, to May 7, 2023), 4291 procedures were manually logged by residents, compared with 7617 procedures captured by the automated system during the same period, representing a 78% increase. During assessment of the upload component of the system (May 8, 2023, to June 25, 2023), a total of 1353 procedures and patient encounters were evaluated, with the system operating with a sensitivity of 97.4%, specificity of 100%, and overall accuracy of 99.5%. Conclusions and Relevance In this quality improvement study of emergency medicine resident physicians, an automated system demonstrated that reliance on self-reported procedure logging resulted in significant procedural underreporting compared with the use of data obtained at the point of performance. Additionally, this system afforded a degree of reliability and validity heretofore absent from the usual after-the-fact procedure logging workflows while using a novel application programming interface–based approach. To our knowledge, this system constitutes the first generalizable implementation of an automated solution to a problem that has existed in graduate medical education for decades.

medicine, general & internal
The House Cup: Using Longitudinal Gamification to Improve Didactic Attendance

Brian P Elliott,Joseph Glendening,Sahana Venkatesh,Ammar Ahmad,James Prister,Kathryn M Burtson

DOI: https://doi.org/10.1177/23821205231225922

2024-01-10

Abstract:Objective: Determine if a point-based attendance system combined with longitudinal gamification is feasible and improves didactic session attendance and learner perceptions at our internal medicine residency. Methods: A prospective before-after cohort study. Weekly attendance was tracked from June 2022 through April 2023 at our university-affiliated internal medicine residency program. We implemented a point-based longitudinal game incentivizing residents to attend didactics with positive reinforcement in July 2022 (C: carrot). We added tiered positive reinforcement and positive punishment to the game in January 2023 (CS: carrot and stick). Attendance during these periods was compared to pre (P) and postintervention (S). Perceptions were assessed during the P, C, and CS periods with Likert scale ratings. Results: CS was associated with higher attendance than other study periods (P = .002). Median attendance was P-51% (IQR 37.5-64.5), C-65% (IQR 50-74), CS-81% (IQR 78-94), and S-66% (IQR 63-71). Perceptions were similar during pre and intervention study periods, including perceptions of camaraderie (P-4.4, C-4.4, CS-4.5; P = .56), interest in attending didactic sessions (P-3.7, C-3.4, CS-3.2; P = .21), and mandate as the primary reason for attending didactics (P-3.1, C-3.1, CS-3.2; P = .96). Conclusions: A point-based attendance system combined with a longitudinal game that included tiered positive reinforcement and positive punishment was feasible and associated with higher didactic attendance but not associated with changes in resident perceptions.
Serious Games in Surgical Medical Education: A Virtual Emergency Department as a Tool for Teaching Clinical Reasoning to Medical Students

Seung-Hun Chon,Ferdinand Timmermann,Thomas Dratsch,Nikolai Schuelper,Patrick Plum,Felix Berlth,Rabi Raj Datta,Christoph Schramm,Stefan Haneder,Martin Richard Späth,Martin Dübbers,Julia Kleinert,Tobias Raupach,Christiane Bruns,Robert Kleinert

DOI: https://doi.org/10.2196/13028

2019-03-05

JMIR Serious Games

Abstract:BACKGROUND: Serious games enable the simulation of daily working practices and constitute a potential tool for teaching both declarative and procedural knowledge. The availability of educational serious games offering a high-fidelity, three-dimensional environment in combination with profound medical background is limited, and most published studies have assessed student satisfaction rather than learning outcome as a function of game use.OBJECTIVE: This study aimed to test the effect of a serious game simulating an emergency department ("EMERGE") on students' declarative and procedural knowledge, as well as their satisfaction with the serious game.METHODS: This nonrandomized trial was performed at the Department of General, Visceral and Cancer Surgery at University Hospital Cologne, Germany. A total of 140 medical students in the clinical part of their training (5th to 12th semester) self-selected to participate in this experimental study. Declarative knowledge (measured with 20 multiple choice questions) and procedural knowledge (measured with written questions derived from an Objective Structured Clinical Examination station) were assessed before and after working with EMERGE. Students' impression of the effectiveness and applicability of EMERGE were measured on a 6-point Likert scale.RESULTS: A pretest-posttest comparison yielded a significant increase in declarative knowledge. The percentage of correct answers to multiple choice questions increased from before (mean 60.4, SD 16.6) to after (mean 76.0, SD 11.6) playing EMERGE (P<.001). The effect on declarative knowledge was larger in students in lower semesters than in students in higher semesters (P<.001). Additionally, students' overall impression of EMERGE was positive.CONCLUSIONS: Students self-selecting to use a serious game in addition to formal teaching gain declarative and procedural knowledge.

public, environmental & occupational health,health care sciences & services,medical informatics
Improving Patient Experience Scores in a Pediatric Emergency Department

Beth L. Emerson,Erika Setzer,Kirsten Bechtel,Matthew Grossman

DOI: https://doi.org/10.1097/pq9.0000000000000417

2021-06-23

Pediatric Quality and Safety

Abstract:INTRODUCTION: Patient experience (PE) is an important aspect of the quality of medical care and is associated with positive health outcomes. In the pediatric emergency department (PED), PE is complicated due to the balance of needs between the patient and their family while receiving care. We identified an opportunity to improve our PE, as measured by a survey administered to patients and families following their visit to the PED.METHODS: Utilizing quality improvement methods, we assembled a multidisciplinary team, developed our aims, and evaluated the process. We utilized a key driver diagram and run charts to track our performance. The team additionally monitored several essential subcategories in our improvement process. We aimed to improve our overall PE score from 86.1 to 89.7 over 9 months to align with institutional objectives.RESULTS: Over 6 months, we improved our overall PE score from 86.1 to 89.8. Similarly, each of our subscores of interest (physician performance, things for patients to do in the waiting room, waiting time for radiology, staff sensitivity, and communication about delays) increased. Interventions included rounding in the waiting and examination rooms, staff training, team huddles, and a cross-department committee. All measures demonstrated sustained improvement.CONCLUSIONS: Even in this complex setting, a multidisciplinary team's careful and rigorous process evaluation and improvement work can drive measurable PE improvement. We are continuing our efforts to further improve our performance in excellent patient-centered care to this critical population.
Public Performance Metrics: Driving Physician Motivation and Performance

Maxwell Y Jen,Vy Han,Kathryn Bennett,Scott E Rudkin,Andrew C Wong,Erik D Barton,Ronald Goubert

DOI: https://doi.org/10.5811/westjem.2020.1.41798

2020-02-24

Abstract:Introduction: As providers transition from "fee-for-service" to "pay-for-performance" models, focus has shifted to improving performance. This trend extends to the emergency department (ED) where visits continue to increase across the United States. Our objective was to determine whether displaying public performance metrics of physician triage data could drive intangible motivators and improve triage performance in the ED. Methods: This is a single institution, time-series performance study on a physician-in-triage system. Individual physician baseline metrics-number of patients triaged and dispositioned per shift-were obtained and prominently displayed with identifiable labels during each quarterly physician group meeting. Physicians were informed that metrics would be collected and displayed quarterly and that there would be no bonuses, punishments, or required training; physicians were essentially free to do as they wished. It was made explicit that the goal was to increase the number triaged, and while the number dispositioned would also be displayed, it would not be a focus, thereby acting as this study's control. At the end of one year, we analyzed metrics. Results: The group's average number of patients triaged per shift were as follows: Q1-29.2; Q2-31.9; Q3-34.4; Q4-36.5 (Q1 vs Q4, p < 0.00001). The average numbers of patients dispositioned per shift were Q1-16.4; Q2-17.8; Q3-16.9; Q4-15.3 (Q1 vs Q4, p = 0.14). The top 25% of Q1 performers increased their average numbers triaged from Q1-36.5 to Q4-40.3 (ie, a statistically insignificant increase of 3.8 patients per shift [p = 0.07]). The bottom 25% of Q1 performers, on the other hand, increased their averages from Q1-22.4 to Q4-34.5 (ie, a statistically significant increase of 12.2 patients per shift [p = 0.0013]). Conclusion: Public performance metrics can drive intangible motivators (eg, purpose, mastery, and peer pressure), which can be an effective, low-cost strategy to improve individual performance, achieve institutional goals, and thrive in the pay-for-performance era.
A Measure of the Impact on Real-Time Patient Care of Evidence-based Medicine Logs

Jeffrey B Brown,Ajay K Varadhan,Jacob R Albers,Shreyas Kudrimoti,Estelle Cervantes,Phillip Sgobba,Dawn M Yenser,Bryan G Kane

DOI: https://doi.org/10.5811/westjem.18082

Abstract:Introduction: Evidence-based medicine (EBM) is a critical skill for physicians, and EBM competency has been shown to increase implementation of best medical practices, reduce medical errors, and increase patient-centered care. Like any skill, EBM must be practiced, receiving iterative feedback to improve learners' comprehension. Having residents document patient interactions in logbooks to allow for residency program review, feedback, and documentation of competency has been previously described as a best practice within emergency medicine (EM) to document practice-based learning (PBL) competency. Quantifying how residents use the information they query, locate, evaluate, and apply while providing direct patient care can measure the efficacy of EBM education and provide insight into more efficient ways of providing medical care. Methods: Practice-based learning logs were surveys created to record resident EBM activity on-shift and were placed into our residency management software program. Residents were required to submit 3-5 surveys of EBM activity performed during a 28-day rotation during which additional information was sought. This study included all PBL logs completed by EM residents from June 1, 2013-May 11, 2020. Using qualitative methodology, a codebook was created to analyze residents' free-text responses to the prompt: "Based on your research, would you have done anything differently?" The codebook was designed to generate a three-digit code conveying the effect of the researched information on the patient about whom the log was written, as well as whether the information would affect future patient care and whether these decisions were based on scientific evidence. Results: A total of 10,574 logs were included for primary analysis. In total, 1,977 (18.7%) logs indicated that the evidence acquired through research would affect future patient care. Of these, 392 (3.7%) explicitly stated that the EBM activity conducted as part of our project led to real-time changes in patient care in the ED and would change future management of patients as well. Conclusion: We present a proof of concept that PBL log activity can lead to integration of evidence-based medicine into real-time patient care. While a convenience sample, our cohort recorded evidence of both lifelong learning and application to patient care.
Game Experience and Learning Effects of a Scoring-Based Mechanic for Logistical Aspects of Pediatric Emergency Medicine: Development and Feasibility Study

Cevin Zhang,Jannicke Baalsrud Hauge,Karin Pukk Härenstam,Sebastiaan Meijer

DOI: https://doi.org/10.2196/21988

2021-03-11

JMIR Serious Games

Abstract:Background: Using serious games for learning in operations management is well established. However, especially for logistics skills in health care operations, there is little work on the design of game mechanics for learning engagement and the achievement of the desired learning goals. Objective: This contribution presents a serious game design representing patient flow characteristics, systemic resource configurations, and the roles of the players based on a real Swedish emergency ward. The game was tested in a set of game-based learning practices in the modalities of a physical board game and an online multiplayer serious game that implemented the same game structure. Methods: First, survey scores were collected using the Game Experience Questionnaire Core and Social Presence Modules to evaluate the experience and acceptance of the proposed design to gamify real processes in emergency care. Second, lag sequential analysis was applied to analyze the impact of the game mechanics on learning behavior transitions. Lastly, regression analysis was used to understand whether learning engagement attributes could potentially serve as significant predicting variables for logistical performance in a simulated learning environment. Results: A total of 36 students from courses in engineering and management at KTH Royal Institute of Technology participated in both game-based learning practices during the autumn and spring semesters of 2019 and 2020. For the Core Module, significant differences were found for the scores for negative affect and tension compared with the rest of the module. For the Social Presence Module, significant differences were found in the scores for the psychological involvement - negative feelings dimension compared with the rest of the module. During the process of content generation, the participant had access to circulating management resources and could edit profiles. The standard regression analysis output yielded a ΔR2 of 0.796 (F14,31=2725.49, P<.001) for the board version and 0.702 (F24,31=2635.31, P<.001) for the multiplayer online version after the learning engagement attributes. Conclusions: The high scores of positive affect and immersion compared to the low scores of negative feelings demonstrated the motivating and cognitive involvement impact of the game. The proposed game mechanics have visible effects on significant correlation parameters between the majority of scoring features and changes in learning engagement attributes. Therefore, we conclude that for enhancing learning in logistical aspects of health care, serious games that are steered by well-designed scoring mechanisms can be used.
Enhancing emergency competencies in healthcare professionals via murder mystery games: An innovative gamification learning-based approach

Li Liping,Fang Xiaoxia,Zhang Yu,Wei Yiwei

DOI: https://doi.org/10.1016/j.ienj.2024.101510

2024-09-06

Abstract:Background: Enhancing the emergency competencies of healthcare professionals is essential for ensuring patient safety, optimizing emergency response efficiency, and fostering effective team collaboration. However, traditional simulation-based methods often struggle to accurately replicate real-life emergencies, resulting in outcomes that may not fully reflect actual performance, thereby undermining their effectiveness in training and developing the critical skills needed for emergency situations. Objective: This study evaluated the effectiveness of using murder mystery games (MMGs) as a gamified learning method to enhance the emergency competencies of healthcare professionals. Methods: Twelve scripts of emergency scenarios were developed for the MMGs, and five assessment scales were established, covering emergency response, scenario decision-making, team collaboration, emotional support, and human care. Questionnaire data were analyzed between the experimental and control groups using Chi-square tests for five dimensions and nineteen indicators of emergency competencies. Results: The performance of the experimental group in emergency response and emotional support was significantly higher than that of the control group (P<0.001). The experimental group also showed notable excellence in scenario decision-making, team collaboration, and human care (P<0.005). Conclusions: Emergency capabilities can be significantly enhanced through murder mystery games, providing robust support for improving the quality of medical services.
Gamification in Critical Care Education and Practice

Gary Alan Bass,Cherylee W J Chang,Lauren R Sorce,Sanjay Subramanian,Adam D Laytin,Reka Somodi,Jaime R Gray,Meghan Lane-Fall,Lewis J Kaplan

DOI: https://doi.org/10.1097/CCE.0000000000001034

2024-01-19

Abstract:Objectives: To explore gamification as an alternative approach to healthcare education and its potential applications to critical care. Data sources: English language manuscripts addressing: 1) gamification theory and application in healthcare and critical care and 2) implementation science focused on the knowledge-to-practice gap were identified in Medline and PubMed databases (inception to 2023). Study selection: Studies delineating gamification underpinnings, application in education or procedural mentoring, utilization for healthcare or critical care education and practice, and analyses of benefits or pitfalls in comparison to other educational or behavioral modification approaches. Data extraction: Data indicated the key gamification tenets and the venues within which they were used to enhance knowledge, support continuing medical education, teach procedural skills, enhance decision-making, or modify behavior. Data synthesis: Gamification engages learners in a visual and cognitive fashion using competitive approaches to enhance acquiring new knowledge or skills. While gamification may be used in a variety of settings, specific design elements may relate to the learning environment or learner styles. Additionally, solo and group gamification approaches demonstrate success and leverage adult learning theory elements in a low-stress and low-risk setting. The potential for gamification-driven behavioral modification to close the knowledge-to-practice gap and enable guideline and protocol compliance remains underutilized. Conclusions: Gamification offers the potential to substantially enhance how critical care professionals acquire and then implement new knowledge in a fashion that is more engaging and rewarding than traditional approaches. Accordingly, educational undertakings from courses to offerings at medical professional meetings may benefit from being gamified.

A Little Fun, A Big Impact - Gamification Doubles the Number of Procedures Logged by Emergency Medicine Residents

Gamification of graduate medical education in an emergency medicine residency program

Escape the Monotony: Gamification Enhances Nursing Education

Gamification of emergency medicine cost awareness education

Enhancing triage accuracy in emergency nurses: The impact of a game-based triage educational app

Emergency Medicine Obstetrics and Gynecology: A Case-Based Curriculum for Residents

Disaster day: a simulation-based competition for educating emergency medicine residents and medical students on disaster medicine

Trapped as a Group, Escape as a Team: Applying Gamification to Incorporate Team-building Skills Through an ‘Escape Room’ Experience

How Many Lives Will You Save? A Mixed Methods Evaluation of a Novel, Online Game for Patient Safety and Quality Improvement Education

Association of a Gamified Journal Club on Internal Medicine Residents' Engagement and Critical Appraisal Skills

Effectiveness of gamified team competition as mHealth intervention for medical interns: a cluster micro-randomized trial

Using Gamified Sim for Annual Education

Physician Trainee Procedure Logging via Electronic Health Records

The House Cup: Using Longitudinal Gamification to Improve Didactic Attendance

Serious Games in Surgical Medical Education: A Virtual Emergency Department as a Tool for Teaching Clinical Reasoning to Medical Students

Improving Patient Experience Scores in a Pediatric Emergency Department

Public Performance Metrics: Driving Physician Motivation and Performance

A Measure of the Impact on Real-Time Patient Care of Evidence-based Medicine Logs

Game Experience and Learning Effects of a Scoring-Based Mechanic for Logistical Aspects of Pediatric Emergency Medicine: Development and Feasibility Study

Enhancing emergency competencies in healthcare professionals via murder mystery games: An innovative gamification learning-based approach

Gamification in Critical Care Education and Practice