Abstract:Cholecystectomy (gallbladder removal) is one of the most common procedures in the US, with more than 1.2M procedures annually. Compared with classical open cholecystectomy, laparoscopic cholecystectomy (LC) is associated with significantly shorter recovery period, and hence is the preferred method. However, LC is also associated with an increase in bile duct injuries (BDIs), resulting in significant morbidity and mortality. The primary cause of BDIs from LCs is misidentification of the cystic duct with the bile duct. Critical view of safety (CVS) is the most effective of safety protocols, which is said to be achieved during the surgery if certain criteria are met. However, due to suboptimal understanding and implementation of CVS, the BDI rates have remained stable over the last three decades. In this paper, we develop deep-learning techniques to automate the assessment of CVS in LCs. An innovative aspect of our research is on developing specialized learning techniques by incorporating domain knowledge to compensate for the limited training data available in practice. In particular, our CVS assessment process involves a fusion of two segmentation maps followed by an estimation of a certain region of interest based on anatomical structures close to the gallbladder, and then finally determination of each of the three CVS criteria via rule-based assessment of structural information. We achieved a gain of over 11.8% in mIoU on relevant classes with our two-stream semantic segmentation approach when compared to a single-model baseline, and 1.84% in mIoU with our proposed Sobel loss function when compared to a Transformer-based baseline model. For CVS criteria, we achieved up to 16% improvement and, for the overall CVS assessment, we achieved 5% improvement in balanced accuracy compared to DeepCVS under the same experiment settings.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in laparoscopic cholecystectomy (LC), by automatically evaluating the "Critical View of Safety" (CVS), to reduce the incidence of bile duct injuries (BDIs). ### Problem Background: 1. **Popularity and Risks of LC Surgery**: - Laparoscopic cholecystectomy (LC) is a common surgical operation, with more than 1.2 million cases performed in the United States every year. - Compared with traditional open cholecystectomy, LC has the advantage of a short recovery period, so it has become the preferred method. - However, the risk of bile duct injury (BDI) in LC surgery increases, leading to serious complications and even endangering the patient's life and safety. BDI also increases medical litigation and medical costs. 2. **Importance of CVS**: - CVS is an effective safety protocol, aiming to reduce the occurrence of BDI by ensuring the correct identification of the cystic duct. - CVS requires three conditions to be met: - C1: All fibrous and fatty tissues in the hepatocystic triangle are removed. - C2: The lower one - third part of the gallbladder is separated from the cystic plate. - C3: Only two structures entering the gallbladder (i.e., the cystic duct and the cystic artery) are seen. - Although the effectiveness of CVS has been widely recognized, due to insufficient understanding and improper implementation by surgeons, the incidence of BDI has not decreased significantly in the past three decades. ### Goals of the Paper: - **Automated Evaluation of CVS**: Develop deep - learning techniques to automatically evaluate CVS in LC surgery, in order to improve the accuracy and consistency of CVS, thereby reducing the occurrence of BDI. - **Integration of Domain Knowledge**: Combine professional knowledge in the medical field to compensate for the challenges brought by limited training data and improve the performance of the model. - **Specific Contributions**: - A two - stream semantic segmentation method is proposed to solve the problem of class imbalance. - A new Sobel loss function is introduced to reduce artifacts and over - segmentation in the edge area. - A rule - based method is developed to estimate the region of interest (ROI) and evaluate CVS conditions. Through these methods, the paper demonstrates the superior performance of its model in CVS evaluation, especially the improvement in individual CVS conditions and overall CVS classification.

Automated Assessment of Critical View of Safety in Laparoscopic Cholecystectomy

Surgical data science for safe cholecystectomy: a protocol for segmentation of hepatocystic anatomy and assessment of the critical view of safety

Laparoscopic cholecystectomy critical view of safety (LC-CVS): a multi-national validation study of an objective, procedure-specific assessment using video-based assessment (VBA)

A multi-national, video-based qualitative study to refine training guidelines for assigning an "unsafe" score in laparoscopic cholecystectomy critical view of safety

SurgSmart: an Artificial Intelligent System for Quality Control in Laparoscopic Cholecystectomy: an Observational Study.

Patch-based classification of gallbladder wall vascularity from laparoscopic images using deep learning

Artificial Intelligence in Laparoscopic Cholecystectomy: Does Computer Vision Outperform Human Vision?

Development of an artificial intelligence system using deep learning to indicate anatomical landmarks during laparoscopic cholecystectomy

Latent Graph Representations for Critical View of Safety Assessment

Artificial Intelligence-Based Automated Laparoscopic Cholecystectomy Surgical Phase Recognition and Analysis

Surgical Region of Interest Detection from Laparoscopic Images Using Boundary Fuzziness

Deep learning-based surgical phase recognition in laparoscopic cholecystectomy

Impact of an AI-Based laparoscopic cholecystectomy coaching program on the surgical performance: a randomized controlled trial

Using neural networks to autonomously assess adequacy in intraoperative cholangiograms

Education in Laparoscopic Cholecystectomy: Design and Feasibility Study of the LapBot Safe Chole Mobile Game

Avoidance of bile duct injury in laparoscopic cholecystectomy with feasible intraoperative resources: A cohort study

Automated segmentation of phases, steps, and tasks in laparoscopic cholecystectomy using deep learning

Critical view of safety approach vs. infundibular technique in laparoscopic cholecystectomy, which one is safer? A systematic review and meta-analysis

Use of Deep Learning for Liver Segmentation During Laparoscopic Cholecystectomy

Comments On: A Computer Vision Platform to Automatically Locate Critical Events in Surgical Videos: Documenting Safety in Laparoscopic Cholecystectomy

Safe laparoscopic cholecystectomy: Adoption of universal culture of safety in cholecystectomy