Abstract:Context: Health simulation is a recognized educational method for teaching and validating surgical procedural skills. The latter requires the development of adapted assessment tools, reaching different validity criteria. The aim of this study was to validate a multimodal assessment tool for a complex skin suturing exercise, combining a manual knot, an intradermal linear suturing and a needle holder tied knot. Methodology: The suturing exercise was realized on a synthetic skin model by voluntary participants after having obtained their written consent, including 9 postgraduate medical students, 40 surgical residents of different levels of experience, and a group of 9 senior surgeons. The multimodal assessment tool (MAT) combined a checklist, a speed score and a global rating scale. Each exercise was scored by two evaluators. Medical students' performances were filmed anonymously so that they could be scored iteratively. Content validity was tested through a satisfaction questionnaire randomly completed by participants. Results: The MAT was considered relevant or very relevant by 98% of the participants, with a better appreciation for the checklist than for the global rating scale. Internal consistency was strong with a Cronbach α coefficient at 0.78, and a good correlation between the results of the checklist and the global rating scale (r=0.79, P<0.0001). The MAT showed continuous improvement in mean scores from 34.4±3.6 for novices to 47.4±2.5/50 points for experts, passing through three intermediate levels groups, and allowed for significant discrimination between groups. The MAT was reliable, with a coefficient of correlation set at 0.88 for intra-observer reliability, and 0.72 for inter-observer reliability. On sub score analysis, the global rating scale and the speed score better discriminated between groups than the checklist, the latter moreover showing slightly lower reliability than the global rating scale. Conclusion: Despite its banality in any surgeon's practice and the fact that it is taught from the 2nd cycle of medical studies, suturing and its technical components have rarely been the subject of publications dedicated to the validation of specific assessment tools. Hence, this work on the MAT and its sub scores made it possible to validate them on many validity and reliability criteria. They can therefore be proposed to surgical teachers for evaluating a complex suturing exercise, with a checklist that is easier to use even for novices and a global rating scale showing better discrimination capacity.

Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy

Assessment of bachelor's theses in a nursing degree with a rubrics system: Development and validation study

Development of Analytic Rubric for Assessing Written Assignments for Evaluating Higher Order Cognition in the First Phase Neuroanatomy Module

Development and Validation of a Quantitative Grading Rubric for High-Fidelity Simulation Assessment

Interrater reliability in the assessment of physiotherapy students

Validation of Checklists and Evaluation of Clinical Skills in Cases of Abdominal Pain With Simulation in Formative, Objective, Structured Clinical Examination With Audiovisual Content in Third-Year Medical Students' Surgical Clerkship

Implementing Rubric-Based Peer Review for Video Microlecture Design in Health Professions Education

[Assessment tool's validation study for a simulation-based skin suturing skill]

Rubric vs. numeric rating scale: agreement among evaluators on endodontic treatments performed by dental students

The use of the objective structured clinical examination to evaluate paediatric cardiopulmonary resuscitation skills in medical students and measures to improve training

The impact of rubrics and scripts on self-regulation, self-efficacy and performance in collaborative problem-solving tasks

Development and preliminary validation of a new task-based objective procedure-specific assessment of inguinal hernia repair procedural safety

Psychometric validation of an instrument to assess undergraduate nursing student's knowledge of the aetiology, prevention and treatment of venous leg ulcers

Exploring the Gap Between Evidence and Judgement: Using video vignettes for practice-based assessment of physiotherapy undergraduates

Effects of Rubrics on Academic Performance, Self-Regulated Learning, and self-Efficacy: a Meta-analytic Review

Identifying Differences In Diagnostic Skills Between Physics Students: Developing A Rubric

Movement Representation Strategies as a Tool for Educational Innovation in Physiotherapy Students: A Randomized Single-Blind Controlled-Pilot Trial

Preliminary Validation of a Clinical Reasoning Theory-Based Assessment Rubric: An e-Delphi Study

Behavioral assessment of soft skill development in a highly structured pre-health biology course for undergraduates

Group Methodologies and Simulations for the Development of Transversal Skills: A Pilot Study on Health Sciences Higher Education

Improving Students With Rubric-Based Self-Assessment and Oral Feedback