Weakly-Supervised Learning via Multi-Lateral Decoder Branching for Guidewire Segmentation in Robot-Assisted Cardiovascular Catheterization

Olatunji Mumini Omisore,Toluwanimi Akinyemi,Anh Nguyen,Lei Wang

2024-04-11

Abstract:Although robot-assisted cardiovascular catheterization is commonly performed for intervention of cardiovascular diseases, more studies are needed to support the procedure with automated tool segmentation. This can aid surgeons on tool tracking and visualization during intervention. Learning-based segmentation has recently offered state-of-the-art segmentation performances however, generating ground-truth signals for fully-supervised methods is labor-intensive and time consuming for the interventionists. In this study, a weakly-supervised learning method with multi-lateral pseudo labeling is proposed for tool segmentation in cardiac angiograms. The method includes a modified U-Net model with one encoder and multiple lateral-branched decoders that produce pseudo labels as supervision signals under different perturbation. The pseudo labels are self-generated through a mixed loss function and shared consistency in the decoders. We trained the model end-to-end with weakly-annotated data obtained during robotic cardiac catheterization. Experiments with the proposed model shows weakly annotated data has closer performance to when fully annotated data is used. Compared to three existing weakly-supervised methods, our approach yielded higher segmentation performance across three different cardiac angiogram data. With ablation study, we showed consistent performance under different parameters. Thus, we offer a less expensive method for real-time tool segmentation and tracking during robot-assisted cardiac catheterization.

Computer Vision and Pattern Recognition,Machine Learning,Robotics

What problem does this paper attempt to address?

This paper attempts to address the problem of guidewire segmentation in robot-assisted cardiovascular catheterization using weakly supervised learning methods. Specifically, the authors propose a weakly supervised learning method based on a multi-side branch decoder for guidewire segmentation in cardiac angiography images. This method aims to reduce the time and labor costs required to generate high-quality annotated data while maintaining segmentation performance close to that of fully supervised methods.

### Main Issues
1. **High cost of generating high-quality annotated data**: Traditional fully supervised learning methods require a large amount of manually annotated data, which is not only time-consuming but also costly.
2. **Need for real-time tool tracking and visualization**: In robot-assisted cardiovascular catheterization, real-time tool tracking and visualization are crucial for the success of the surgery.
3. **Insufficient performance of existing weakly supervised methods**: Existing weakly supervised learning methods usually do not perform as well as fully supervised methods, especially when dealing with dynamic and complex cardiac angiography images.

### Solution
1. **Multi-side branch decoder**: The authors propose a multi-side branch decoder method based on the U-Net architecture, which generates pseudo-labels as supervisory signals through an encoder and multiple decoders.
2. **Shared consistency regularization**: To improve the robustness and generalization ability of the model, the authors introduce shared consistency regularization to ensure the consistency of outputs from different decoders.
3. **Weakly supervised learning**: This method uses partially annotated data for training, reducing the reliance on a large amount of high-quality annotated data while maintaining high segmentation performance.

### Experimental Results
- **Performance validation**: Experimental results show that this method performs well on three different cardiac angiography datasets, with mean Intersection over Union (mIoU) of 70.81%, 67.06%, and 84.19%, respectively, with a small performance gap compared to fully supervised methods.
- **Comparison with existing methods**: Compared with three other existing weakly supervised methods, this method performs better in segmentation performance, approaching the level of fully supervised methods.

### Conclusion
This study proposes an effective weakly supervised learning method that can achieve guidewire segmentation performance close to that of fully supervised methods while reducing annotation costs. Future work will further extend this method to achieve real-time tool tracking and visualization.