SAM-EG: Segment Anything Model with Egde Guidance framework for efficient Polyp Segmentation

Quoc-Huy Trinh,Hai-Dang Nguyen,Bao-Tram Nguyen Ngoc,Debesh Jha,Ulas Bagci,Minh-Triet Tran
2024-06-21
Abstract:Polyp segmentation, a critical concern in medical imaging, has prompted numerous proposed methods aimed at enhancing the quality of segmented masks. While current state-of-the-art techniques produce impressive results, the size and computational cost of these models pose challenges for practical industry applications. Recently, the Segment Anything Model (SAM) has been proposed as a robust foundation model, showing promise for adaptation to medical image segmentation. Inspired by this concept, we propose SAM-EG, a framework that guides small segmentation models for polyp segmentation to address the computation cost challenge. Additionally, in this study, we introduce the Edge Guiding module, which integrates edge information into image features to assist the segmentation model in addressing boundary issues from current segmentation model in this task. Through extensive experiments, our small models showcase their efficacy by achieving competitive results with state-of-the-art methods, offering a promising approach to developing compact models with high accuracy for polyp segmentation and in the broader field of medical imaging.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The paper aims to address the issue of polyp segmentation in the early diagnosis of colorectal cancer (CRC). Specifically, the authors propose a new framework called SAM-EG, which combines the "Segment Anything Model" (SAM) with an Edge Guidance module to improve the performance of small models in polyp segmentation tasks while reducing computational costs. By incorporating the semantic features of SAM into a small segmentation model and utilizing edge information to enhance boundary details, SAM-EG is able to achieve results comparable to or even better than existing state-of-the-art methods on various datasets, particularly excelling in handling small polyps or difficult-to-recognize areas. Additionally, this method significantly reduces the number of parameters and floating-point operations (FLOPs) compared to other advanced models, making it more feasible for practical clinical applications.