Abstract:Objective: Laparoscopic surgical skill assessment and machine learning are often inaccessible to low-and-middle-income countries (LMIC). Our team developed a low-cost laparoscopic training system to teach and assess psychomotor skills required in laparoscopic salpingostomy in LMICs. We performed video review using AI to assess global surgical techniques. The objective of this study was to assess the validity of artificial intelligence (AI) generated scoring measures of laparoscopic simulation videos by comparing the accuracy of AI results to human-generated scores. Design: Seventy-four surgical simulation videos were collected and graded by human participants using a modified OSATS (Objective Structured Assessment of Technical Skills). The videos were then analyzed via AI using 3 different time and distance-based calculations of the laparoscopic instruments including path length, dimensionless jerk, and standard deviation of tool position. Predicted scores were generated using 5-fold cross validation and K-Nearest-Neighbors to train classifiers. Setting: Surgical novices and experts from a variety of hospitals in Ethiopia, Cameroon, Kenya, and the United States contributed 74 laparoscopic salpingostomy simulation videos. Results: Complete accuracy of AI compared to human assessment ranged from 65-77%. There were no statistical differences in rank mean scores for 3 domains, Flow of Operation, Respect for Tissue, and Economy of Motion, while there were significant differences in ratings for Instrument Handling, Overall Performance, and the total summed score of all 5 domains (Summed). Estimated effect sizes were all less than 0.11, indicating very small practical effect. Estimated intraclass correlation coefficient (ICC) of Summed was 0.72 indicating moderate correlation between AI and Human scores. Conclusions: Video review using AI technology of global characteristics was similar to that of human review in our laparoscopic training system. Machine learning may help fill an educational gap in LMICs where direct apprenticeship may not be feasible.

Development and validation of a deep-learning based assistance system for enhancing laparoscopic control level

Development and validation of a deep learning-based laparoscopic system for improving video quality

Vision-Based Real-Time Tracking of Surgical Instruments in Robot-Assisted Laparoscopic Surgery

Using Artificial Intelligence to Gauge Competency on a Novel Laparoscopic Training System

Intelligent cataract surgery supervision and evaluation via deep learning

Automatic Guidance of Laparoscope Based on the Region of Interest for Robot Assisted Laparoscopic Surgery

Surgical Phase Recognition in Inguinal Hernia Repair—AI-Based Confirmatory Baseline and Exploration of Competitive Models

Deep Learning with Convolutional Neural Network for Objective Skill Evaluation in Robot-assisted Surgery

3D Perception based Imitation Learning under Limited Demonstration for Laparoscope Control in Robotic Surgery

Development of a Deep Learning System for Intra-Operative Identification of Cancer Metastases

Deep learning-based surgical phase recognition in laparoscopic cholecystectomy

Development, deployment and scaling of operating room-ready artificial intelligence for real-time surgical decision support

Decoding surgical skill: an objective and efficient algorithm for surgical skill classification based on surgical gesture features -experimental studies

Automated surgical skill assessment in colorectal surgery using a deep learning-based surgical phase recognition model

Learning Laparoscope Actions via Video Features for Proactive Robotic Field-of-View Control

Effect of virtual reality training to enhance laparoscopic assistance skills

VS-Assistant: Versatile Surgery Assistant on the Demand of Surgeons

Quantification of Robotic Surgeries with Vision-Based Deep Learning

Towards Augmented Reality-based Suturing in Monocular Laparoscopic Training

Clean visual field reconstruction in robot-assisted laparoscopic surgery based on dynamic prediction

Data-driven Holistic Framework for Automated Laparoscope Optimal View Control with Learning-based Depth Perception