Using the Kirkpatrick Model to Evaluate the Effect of a Primary Trauma Care Course on Health Care Workers' Knowledge, Attitude, and Practice in Two Vietnamese Local Hospitals: Prospective Intervention Study
Ba Tuan Nguyen,Van Anh Nguyen,Christopher Leigh Blizzard,Andrew Palmer,Huu Tu Nguyen,Thang Cong Quyet,Viet Tran,Marcus Skinner,Haydn Perndt,Mark R Nelson
DOI: https://doi.org/10.2196/47127
2024-07-23
Abstract:Background: The Primary Trauma Care (PTC) course was originally developed to instruct health care workers in the management of patients with severe injuries in low- and middle-income countries (LMICs) with limited medical resources. PTC has now been taught for more than 25 years. Many studies have demonstrated that the 2-day PTC workshop is useful and informative to frontline health staff and has helped improve knowledge and confidence in trauma management; however, there is little evidence of the effect of the course on changes in clinical practice. The Kirkpatrick model (KM) and the knowledge, attitude, and practice (KAP) model are effective methods to evaluate this question. Objective: The aim of this study was to investigate how the 2-day PTC course impacts the satisfaction, knowledge, and skills of health care workers in 2 Vietnamese hospitals using a conceptual framework incorporating the KAP model and the 4-level KM as evaluation tools. Methods: The PTC course was delivered over 2 days in the emergency departments (EDs) of Thanh Hoa and Ninh Binh hospitals in February and March 2022, respectively. This study followed a prospective pre- and postintervention design. We used validated instruments to assess the participants' satisfaction, knowledge, and skills before, immediately after, and 6 months after course delivery. The Fisher exact test and the Wilcoxon matched-pairs signed rank test were used to compare the percentages and mean scores at the pretest, posttest, and 6-month postcourse follow-up time points among course participants. Results: A total of 80 health care staff members attended the 2-day PTC course and nearly 100% of the participants were satisfied with the course. At level 2 of the KM (knowledge), the scores on multiple-choice questions and the confidence matrix improved significantly from 60% to 77% and from 59% to 71%, respectively (P<.001), and these improvements were seen in both subgroups (nurses and doctors). The focus of level 3 was on practice, demonstrating a significant incremental change, with scenarios checklist points increasing from a mean of 5.9 (SD 1.9) to 9.0 (SD 0.9) and bedside clinical checklist points increasing from a mean of 5 (SD 1.5) to 8.3 (SD 0.8) (both P<.001). At the 6-month follow-up, the scores for multiple-choice questions, the confidence matrix, and scenarios checklist all remained unchanged, except for the multiple-choice question score in the nurse subgroup (P=.005). Conclusions: The PTC course undertaken in 2 local hospitals in Vietnam was successful in demonstrating improvements at 3 levels of the KM for ED health care staff. The improvements in the confidence matrix and scenarios checklist were maintained for at least 6 months after the course. PTC courses should be effective in providing and sustaining improvement in knowledge and trauma care practice in other LMICs such as Vietnam.