Abstract:Importance: Assessing nontechnical skills in operating rooms (ORs) is crucial for enhancing surgical performance and patient safety. However, automated and real-time evaluation of these skills remains challenging. Objective: To explore the feasibility of using motion features extracted from surgical video recordings to automatically assess nontechnical skills during cardiac surgical procedures. Design, setting, and participants: This cross-sectional study used video recordings of cardiac surgical procedures at a tertiary academic US hospital collected from January 2021 through May 2022. The OpenPose library was used to analyze videos to extract body pose estimations of team members and compute various team motion features. The Non-Technical Skills for Surgeons (NOTSS) assessment tool was employed for rating the OR team's nontechnical skills by 3 expert raters. Main outcomes and measures: NOTSS overall score, with motion features extracted from surgical videos as measures. Results: A total of 30 complete cardiac surgery procedures were included: 26 (86.6%) were on-pump coronary artery bypass graft procedures and 4 (13.4%) were aortic valve replacement or repair procedures. All patients were male, and the mean (SD) age was 72 (6.3) years. All surgical teams were composed of 4 key roles (attending surgeon, attending anesthesiologist, primary perfusionist, and scrub nurse) with additional supporting roles. NOTSS scores correlated significantly with trajectory (r = 0.51, P = .005), acceleration (r = 0.48, P = .008), and entropy (r = -0.52, P = .004) of team displacement. Multiple linear regression, adjusted for patient factors, showed average team trajectory (adjusted R2 = 0.335; coefficient, 10.51 [95% CI, 8.81-12.21]; P = .004) and team displacement entropy (adjusted R2 = 0.304; coefficient, -12.64 [95% CI, -20.54 to -4.74]; P = .003) were associated with NOTSS scores. Conclusions and relevance: This study suggests a significant link between OR team movements and nontechnical skills ratings by NOTSS during cardiac surgical procedures, suggesting automated surgical video analysis could enhance nontechnical skills assessment. Further investigation across different hospitals and specialties is necessary to validate these findings.

Depth over RGB: automatic evaluation of open surgery skills using depth camera

Depth Over RGB: Automatic Evaluation of Open Surgery Skills Using Depth Camera

3D endoscopic depth estimation using 3D surface-aware constraints

Leveraging Near-Field Lighting for Monocular Depth Estimation from Endoscopy Videos

Surgical Depth Anything: Depth Estimation for Surgical Scenes using Foundation Models

Using hand pose estimation to automate open surgery training feedback

Self-Supervised Depth Estimation in Laparoscopic Image using 3D Geometric Consistency

Stereo Video Reconstruction Without Explicit Depth Maps for Endoscopic Surgery

Deep Learning Analysis of Surgical Video Recordings to Assess Nontechnical Skills

Augmented Reality for Depth Cues in Monocular Minimally Invasive Surgery

Self-Supervised Siamese Learning on Stereo Image Pairs for Depth Estimation in Robotic Surgery

Video-based fully automatic assessment of open surgery suturing skills

Depth Completion with RGB Prior

Applying Depth-Sensing to Automated Surgical Manipulation with a da Vinci Robot

Quantitative Depth Quality Assessment of RGBD Cameras At Close Range Using 3D Printed Fixtures

Distilled Visual and Robot Kinematics Embeddings for Metric Depth Estimation in Monocular Scene Reconstruction

Toward Intraoperative Visual Intelligence: Real-Time Surgical Instrument Segmentation for Enhanced Surgical Monitoring

Dynamic Depth-Supervised NeRF for Multi-View RGB-D Operating Room Images

Rethinking RGB-D Fusion for Semantic Segmentation in Surgical Datasets

E-DSSR: Efficient Dynamic Surgical Scene Reconstruction with Transformer-based Stereoscopic Depth Perception

Learning How To Robustly Estimate Camera Pose in Endoscopic Videos