Abstract:Introduction: Assessment of surgical resident technical performance is an integral component of any surgical training program. Timely assessment delivered in a structured format is a critical step to enhance technical skills, but residents often report that the quality and quantity of timely feedback received is lacking. Moreover, the absence of written feedback with specificity can allow residents to seemingly progress in their operative milestones as a junior resident, but struggle as they progress into their postgraduate year 3 and above. We therefore designed and implemented a web-based intraoperative assessment tool and corresponding summary "dashboard" to facilitate real-time assessment and documentation of technical performance. Materials and methods: A web form was designed leveraging a cloud computing platform and implementing a modified Ottawa Surgical Competency Operating Room Evaluation instrument; this included additional, procedure-specific criteria for select operations. A link to this was provided to residents via email and to all surgical faculty as a Quick Response code. Residents open and complete a portion of the form on a smartphone, then relinquish the device to an attending surgeon who then completes and submits the assessment. The data are then transferred to a secure web-based reporting interface; each resident (together with a faculty advisor) can then access and review all completed assessments. Results: The Assessment form was activated in June 2021 and formally introduced to all residents in July 2021, with residents required to complete at least one assessment per month. Residents with less predictable access to operative procedures (night float or Intensive Care Unit) were exempted from the requirement on those months. To date a total of 559 assessments have been completed for operations performed by 56 trainees, supervised by 122 surgical faculty and senior trainees. The mean number of procedures assessed per resident was 10.0 and the mean number per assessor was 4.6. Resident initiation of Intraoperative Assessments has increased since the tool was introduced and scores for technical and nontechnical performance reliably differentiate residents by seniority. Conclusions: This novel system demonstrates that an online, resident-initiated technical assessment tool is feasible to implement and scale. This model's requirement that the attending enter performance ratings into the trainee's electronic device ensures that feedback is delivered directly to the trainee. Whether this aspect of our assessment ensures more direct and specific (and therefore potentially actionable) feedback is a focus for future study. Our use of commercial cloud computing services should permit cost-effective adoption of similar systems at other training programs.

Development of the "LAser Surgical skills Evaluation for Residents" (LASER) Scale Through a Modified Delphi Method

Assessment of Surgical Competences for Neck Dissection and Total Laryngectomy on Revascularized Cadaver Models: Onco-Neck-Score and Onco-Larynx-Score

Evaluation and application of CO2 laser fiber delivery for single port transoral robotic surgery

Using learning-by-concordance to develop reasoning in epistaxis management with online feedback: A pilot study

Development and Validation of a Low-Cost and Simple Simulator for Microlaryngeal Surgery

Learning Outcomes and Educational Effectiveness of E-Learning as a Continuing Professional Development Intervention for Practicing Surgeons and Proceduralists: A Systematic Review

Development and Validation of Instrument for Operative Competency Assessment in Selective Neck Dissection

A multi-national, video-based qualitative study to refine training guidelines for assigning an "unsafe" score in laparoscopic cholecystectomy critical view of safety

Laparoscopic cholecystectomy critical view of safety (LC-CVS): a multi-national validation study of an objective, procedure-specific assessment using video-based assessment (VBA)

Validation of a 3D-Printed Silicone-Based Laryngeal Model for Resident Education

μRALP and Beyond: Micro-Technologies and Systems for Robot-Assisted Endoscopic Laser Microsurgery

Implementation and Validation of an Automated, Longitudinal Robotic Surgical Evaluation and Feedback Program at a High-volume Center and Impact on Training

Defining the Essential Leadership Skills for Surgical Residents Leading Inpatient Teams: A Modified Delphi Study

Implementation of an Online Intraoperative Assessment of Technical Performance for Surgical Trainees

Designing Entrustable Professional Activities for Treatment Planning of Oral Cancer by Maxillofacial Surgery Residents: A Modified Delphi Study

Development and evaluation of a societal core robotic surgery accreditation curriculum for the UK

Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study

Expert Consensus on Clinical Recommendations for Fractional Ablative CO2 Laser, in Facial Skin Rejuvenation Treatment

Future Surgical Leaders: Resident Perception Of Longitudinal Leadership And Non-Technical Skills Curriculum

Bending the rules: A novel approach to laryngeal surgery in a body donor study

Perceptions regarding the use of a three‐dimensionally‐printed manufactured educational simulator for periodontal treatment of intraosseous and interradicular lesions