Abstract:Background Surgical education lacks a standardized, proficiency-based approach to evaluation and feedback. Objective To assess the implementation and reception (ie, feasibility) of an automated, standardized, longitudinal surgical skill assessment and feedback system, and identify baseline trainee (resident and fellow) characteristics associated with achieving proficiency in robotic surgery while learning robotic-assisted laparoscopic prostatectomy. Design, setting, and participants A quality improvement study assessing a pilot of a surgical experience tracking program was conducted over 1 yr. Participants were six fellows, eight residents, and nine attending surgeons at a tertiary cancer center. Intervention Trainees underwent baseline self-assessment. After each surgery, an evaluation was completed independently by the trainee and attending surgeons. Performance was rated on a five-point anchored Likert scale (trainees were considered "proficient" when attending surgeons' rating was ≥4). Technical skills were assessed using the Global Evaluative Assessment of Robotic Skills (GEARS) and Prostatectomy Assessment and Competency Evaluation (PACE). Outcome measurements and statistical analysis Program success and utility were assessed by evaluating completion rates, evaluation completion times, and concordance rates between attending and trainee surgeons, and exit surveys. Baseline characteristics were assessed to determine associations with achieving proficiency. Results and limitations Completion rates for trainees and attending surgeons were 72% and 77%, respectively. Fellows performed more steps/cases than residents (median [interquartile range]: 5 [3–7] and 3 [2–4], respectively; p < 0.01). Prior completion of robotics or laparoscopic skill courses and surgical experience measures were associated with achieving proficiency in multiple surgical steps and GEARS domains. Interclass correlation coefficients on individual components were 0.27–0.47 on GEARS domains. Conclusions An automated surgical experience tracker with structured, longitudinal evaluation and feedback can be implemented with good participation and minimal participant time commitment, and can guide curricular development in a proficiency-based education program by identifying modifiable factors associated with proficiency, individualizing education, and identifying improvement areas within the education program. Patient summary An automated, standardized, longitudinal surgical skill assessment and feedback system can be implemented successfully in surgical education settings and used to inform education plans and predict trainee proficiency.

Rethinking Surgical Safety: Investigating the Impact of Gamified Training on Severe Flow Disruptions in Surgery

Emergent robotic surgery conversions: improving operating room team performance through high fidelity simulations

Barriers to safety and efficiency in robotic surgery docking

Surgical Simulation in Robot-Assisted Thoracic Surgery: Patient Safety

Development of a high fidelity, multidisciplinary, crisis simulation model for robotic surgical teams

Identifying Workflow Disruptions in Robotic-Assisted Bariatric Surgery: Elucidating Challenges Experienced by Surgical Teams

A robotic teaching session: separating tool from technique to emphasize a cognitive focused teaching environment

3D Real-Time Collaborative Environment to Learn Teamwork and Non-technical Skills in the Operating Room

Implementation and Validation of a High-Fidelity Simulation Model for Surgical Resident Training: Management of Acute Intraoperative Hemorrhage during Robot-assisted Surgery

Unleashing surgical skills: Ultra-high fidelity trauma thoracotomy training on knowledge donor platform

Workflow disruptions in robot-assisted surgery

Can gamified surgical sets improve surgical instrument recognition and student performance retention in the operating room? A multi-institutional experimental crossover study

Emergent robot-to-open conversion - Multidisciplinary simulation training in crisis management

Using Gamified Sim for Annual Education

Effectiveness of an interprofessional patient safety team-based learning simulation experience on healthcare professional trainees

Development of an In Situ Thoracic Surgery Crisis Simulation Focused on Nontechnical Skill Training

[Learn playfully, operate seriously : The new era of surgical training]

Understanding the challenges of robotic-assisted surgery adoption: Perspectives from stakeholders and the general population on human-interaction, built environment, and training

Implementation and Validation of an Automated, Longitudinal Robotic Surgical Evaluation and Feedback Program at a High-volume Center and Impact on Training

A new approach for the acquisition of trauma surgical skills: an OSCE type of simulation training program

From simulation to surgery, advancements and challenges in robotic training for radical prostatectomy: a narrative review