Abstract:Context: Health simulation is a recognized educational method for teaching and validating surgical procedural skills. The latter requires the development of adapted assessment tools, reaching different validity criteria. The aim of this study was to validate a multimodal assessment tool for a complex skin suturing exercise, combining a manual knot, an intradermal linear suturing and a needle holder tied knot. Methodology: The suturing exercise was realized on a synthetic skin model by voluntary participants after having obtained their written consent, including 9 postgraduate medical students, 40 surgical residents of different levels of experience, and a group of 9 senior surgeons. The multimodal assessment tool (MAT) combined a checklist, a speed score and a global rating scale. Each exercise was scored by two evaluators. Medical students' performances were filmed anonymously so that they could be scored iteratively. Content validity was tested through a satisfaction questionnaire randomly completed by participants. Results: The MAT was considered relevant or very relevant by 98% of the participants, with a better appreciation for the checklist than for the global rating scale. Internal consistency was strong with a Cronbach α coefficient at 0.78, and a good correlation between the results of the checklist and the global rating scale (r=0.79, P<0.0001). The MAT showed continuous improvement in mean scores from 34.4±3.6 for novices to 47.4±2.5/50 points for experts, passing through three intermediate levels groups, and allowed for significant discrimination between groups. The MAT was reliable, with a coefficient of correlation set at 0.88 for intra-observer reliability, and 0.72 for inter-observer reliability. On sub score analysis, the global rating scale and the speed score better discriminated between groups than the checklist, the latter moreover showing slightly lower reliability than the global rating scale. Conclusion: Despite its banality in any surgeon's practice and the fact that it is taught from the 2nd cycle of medical studies, suturing and its technical components have rarely been the subject of publications dedicated to the validation of specific assessment tools. Hence, this work on the MAT and its sub scores made it possible to validate them on many validity and reliability criteria. They can therefore be proposed to surgical teachers for evaluating a complex suturing exercise, with a checklist that is easier to use even for novices and a global rating scale showing better discrimination capacity.

Construct Validity of a Novel Assessment System for Laparoscopic Suture Accuracy Based on Stereoscopy

Handheld Laparoscopic Robotized Instrument: Progress or Challenge?

Validation of a virtual intracorporeal suturing simulator

Construct, content and face validity of the eoSim laparoscopic simulator on advanced suturing tasks

Inter-rater and intra-rater reliability of the current assessment model and tools for laparoscopic suturing

Competency in Robotic Surgery: Standard Setting for Robotic Suturing Using Objective Assessment and Expert Evaluation

Objective and Automated Quantification of Instrument Handling for Open Surgical Suturing Skill Assessment: A Simulation-Based Study

Using Artificial Intelligence to Gauge Competency on a Novel Laparoscopic Training System

[Assessment tool's validation study for a simulation-based skin suturing skill]

Measuring hand movement for suturing skill assessment: A simulation-based study

Application of multidirectional stitching technology in a laparoscopic suturing instructional program: a randomized controlled trial

Learning Intracorporeal Suture on Pelvitrainer Using a Robotized Versus Conventional Needle Holder

Construct validity of nine new inanimate exercises for robotic surgeon training using a standardized setup

Comparison of Different Sets of Instruments for Laparoendoscopic Single‐site Surgery in a Surgical Simulator with Novices

Application of an Optical Tracking System for Motor Skill Assessment in Laparoscopic Surgery.

Robot assisted versus laparoscopic suturing learning curve in a simulated setting

Intensive Laparoscopic Training Shortens the Learning Curve of Laparoscopic Suturing in Surgical Postgraduate Students: Feasible or Not?

Systematic approach for content and construct validation: Case studies for arthroscopy and laparoscopy

Handheld Robotic Needle Holder Training: Slower but Better

Construct Validity of a Virtual Reality Simulator for Surgical Training in Knee Arthroscopy

Content and construct validation of a robotic surgery curriculum using an electromagnetic instrument tracker