Abstract:Polyp segmentation plays a vital role in accurately locating polyps at an early stage, which holds significant clinical importance for the prevention of colorectal cancer. Various polyp segmentation methods have been developed using fully-supervised deep learning techniques. However, pixel-wise annotation for polyp images by physicians during the diagnosis is both time-consuming and expensive. Moreover, visual foundation models such as the Segment Anything Model (SAM) have shown remarkable performance. Nevertheless, directly applying SAM to medical segmentation may not produce satisfactory results due to the inherent absence of medical knowledge. In this paper, we propose a novel SAM-guided Collaborative Learning Network (SAM-CLNet) for scribble-supervised polyp segmentation, enabling a collaborative learning process between our segmentation network and SAM to boost the model performance. Specifically, we first propose a Cross-level Enhancement and Aggregation Network (CEA-Net) for weakly-supervised polyp segmentation. Within CEA-Net, we propose a Cross-level Enhancement Module (CEM) that integrates the adjacent features to enhance the representation capabilities of different resolution features. Additionally, a Feature Aggregation Module (FAM) is employed to capture richer features across multiple levels. Moreover, we present a box-augmentation strategy that combines the segmentation maps generated by CEA-Net with scribble annotations to create more precise prompts. These prompts are then fed into SAM, generating segmentation SAM-guided masks, which can provide additional supervision to train CEA-Net effectively. Furthermore, we present an Image-level Filtering Mechanism to filter out unreliable SAM-guided masks. Extensive experimental results show that our SAM-CLNet outperforms state-of-the-art weakly-supervised segmentation methods.

Can SAM Segment Polyps?

Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detection

Polyp-SAM: Transfer SAM for Polyp Segmentation

Polyp-SAM++: Can A Text Guided SAM Perform Better for Polyp Segmentation?

ASPS: Augmented Segment Anything Model for Polyp Segmentation

SAM Fails to Segment Anything? – SAM-Adapter: Adapting SAM in Underperformed Scenes: Camouflage, Shadow, Medical Image Segmentation, and More

Self-Prompting Polyp Segmentation in Colonoscopy using Hybrid Yolo-SAM 2 Model

Segment Anything Model for Medical Image Analysis: an Experimental Study

How Segment Anything Model (SAM) Boost Medical Image Segmentation?

Segment Anything Model for Medical Images?

Segment anything model 2: an application to 2D and 3D medical images

Segment Anything Model-guided Collaborative Learning Network for Scribble-supervised Polyp Segmentation

Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-world Applications

Exploring SAM Ablations for Enhancing Medical Segmentation in Radiology and Pathology

Segment Anything Model (SAM) for Radiation Oncology

Medical SAM 2: Segment medical images as video via Segment Anything Model 2

SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentation

Accuracy of Segment-Anything Model (SAM) in medical image segmentation tasks

Segment Anything Model (SAM) for Medical Image Segmentation: A Preliminary Review

Evaluating segment anything model (SAM) on MRI scans of brain tumors

Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imaging