Weakly Supervised Intracranial Hemorrhage Segmentation with YOLO and an Uncertainty Rectified Segment Anything Model

Pascal Spiegler,Amirhossein Rasoulian,Yiming Xiao
2024-09-04
Abstract:Intracranial hemorrhage (ICH) is a life-threatening condition that requires rapid and accurate diagnosis to improve treatment outcomes and patient survival rates. Recent advancements in supervised deep learning have greatly improved the analysis of medical images, but often rely on extensive datasets with high-quality annotations, which are costly, time-consuming, and require medical expertise to prepare. To mitigate the need for large amounts of expert-prepared segmentation data, we have developed a novel weakly supervised ICH segmentation method that utilizes the YOLO object detection model and an uncertainty-rectified Segment Anything Model (SAM). In addition, we have proposed a novel point prompt generator for this model to further improve segmentation results with YOLO-predicted bounding box prompts. Our approach achieved a high accuracy of 0.933 and an AUC of 0.796 in ICH detection, along with a mean Dice score of 0.629 for ICH segmentation, outperforming existing weakly supervised and popular supervised (UNet and Swin-UNETR) approaches. Overall, the proposed method provides a robust and accurate alternative to the more commonly used supervised techniques for ICH quantification without requiring refined segmentation ground truths during model training.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the rapid and accurate diagnosis of intracranial hemorrhage (ICH), especially how to achieve effective ICH segmentation with limited high - quality labeled data. Specifically, although traditional supervised learning methods have made significant progress in medical image analysis, these methods usually rely on a large number of high - quality labeled data sets, and the preparation of these data sets is time - consuming, requires professional knowledge, and is costly. In order to reduce the need for a large amount of expert - labeled segmentation data, the author has developed a new weakly - supervised ICH segmentation method, which combines the YOLO object detection model and an uncertainty - corrected "Segment Anything Model" (SAM). In addition, the author also proposes a new point - prompt generator to further improve the segmentation effect using the bounding box prompts predicted by YOLO. The main contributions of the paper include: 1. Using the fine - tuned YOLOv8 model and a new morphological method to automatically generate bounding boxes and point prompts for SAM. 2. Adopting an uncertainty - correction method to improve the segmentation accuracy of SAM by considering the uncertainty in prompt generation. 3. Exploring the impact of different prompt types on the proposed framework in ICH segmentation and comparing it with existing weakly - supervised and popular supervised methods (such as UNet and Swin - UNETR). Through this method, the paper aims to provide a robust and accurate alternative for ICH quantification that can be trained without fine - segmented ground truth, thereby overcoming the bottleneck of data preparation in traditional supervised learning methods.