Multi-center empirical study of virtual gastroscopy simulator in the examination of clinical practice skills of specialist physicians
Mingyan Cai,Shiyao Chen,Xinhua Li,Xiaowei Liu,Xiong Jie,Shuchang Xu,Pinghong Zhou
DOI: https://doi.org/10.3760/cma.j.issn.1671-0274.2019.10.013
2019-01-01
Abstract: To study the role of virtual gastroscopy simulator in the examination of clinical practice skills of gastrointestinal specialists. A multi-center empirical study was carried out. In June 2018, ninety participants from three tertiary care teaching hospitals in China, including Zhongshan Hospital of Fudan University, Shanghai Tongji Hospital and Xiangya Hospital of Central South University, took part in the examination. Participants were selected as follows: 30 specialists without any experience of gastroscopy exams, 30 with basic knowledge (gastroscopy exams <500 cases) and 30 with good skill (gastroscopy exams ≥500 cases). These 90 students participated in this empirical study after theoretical study and simulator training. Among them, 50 (55.6%) were undergraduates, 25 (27.8%) masters, and 15 (16.7%) doctors; 42 (46.7%) were residents, 39 (43.3%) attending physicians, and 9 (10.0%) deputy chief physicians. The assessment was divided into two parts. The first part was to use the simulator (GI mentor II) for ballooning within 10 minutes, with a total score of 40 points. The second part was a complete gastroscopy exam on the simulator, including preparation before gastroscopy exam, gastroscopy exam, post - exam management and related knowledge quiz. The difficulty and discrimination of the assessment plan were evaluated by the extreme grouping method parameters (difficulty definition: <0.3 was difficult, 0.3 to 0.7 was medium, ≥0.7 was easy; discrimination degree D definition: <0 was poor, 0 to 0.2 was medium, ≥0.2 was good), and by comparing the virtual gastroscopy assessment scores of different experience, academic, and professional title groups. The score analysis of the student group was expressed using the mastering rate (the average score divided by the total score). The data of the normal distribution was represented by (mean±SD) (range), and the data of the nonnormal distribution was represented by (25, 75). Kruskal-Wallis non-parametric test was used for comparison between groups. The total score of 90 students was (82.9±10.9) (55.8 to 99.0), and the mastering rate was 82.9%. The overall difficulty of the first and the second parts were 0.78 and 0.76, respectively, and the difficulty level was easy. The overall discrimination of the first and the second parts were 0.70 and 0.67, respectively, and the discrimination was good. The stratified analysis was performed according to the professional title. The median score was 83.2 (75.5, 89.0) in the residents, 82.5 (71.7, 93.6) in the attending physicians, and 93.5 (88.5, 99.0) in the deputy chief physicians, and the difference was statistically significant (=6.213, =0.045). According to the stratification analysis of academic qualifications, the median score was 81.7 (73.0, 87.5) in participants with undergraduate degree, 91.0 (79.0, 95.0) in those with master degree and 88.0 (81.7, 93.5) in those with doctor degree, whose difference was statistically significant (=9.233, =0.010). The stratified analysis of the second part showed that the median scores of the "operational process" part of the low, medium and high basis group were 33.0 (30.5, 36.5), 34.0 (32.0, 36.0) and 37.0 (35.0, 37.5), respectively, whose difference was statistically significant (=7.603, =0.022). The median scores of the "operational process" section of the resident, attending physician, and deputy chief physician were 33.0 (30.5, 35.0) points, 36.0 (34.0, 37.5) points and 37.0 (37.0, 37.5) points, respectively, whose difference was statistically significant (=18.563, =0.001). The virtual gastroscopy simulator can reflect the true level of gastroscopy exam skills of the students. The examination questions are moderately difficult, and there is a good discrimination of the exam.