Abstract:Automatic and precise polyp segmentation in colonoscopy images is highly valuable for diagnosis at an early stage and surgery of colorectal cancer. Nevertheless, it still posed a major challenge due to variations in the size and intricate morphological characteristics of polyps coupled with the indistinct demarcation between polyps and mucosas. To alleviate these challenges, we proposed an improved dual-aggregation polyp segmentation network, dubbed Dua-PSNet, for automatic and accurate full-size polyp prediction by combining both the transformer branch and a fully convolutional network (FCN) branch in a parallel style. Concretely, in the transformer branch, we adopted the B3 variant of pyramid vision transformer v2 (PVTv2-B3) as an image encoder for capturing multi-scale global features and modeling long-distant interdependencies between them whilst designing an innovative multi-stage feature aggregation decoder (MFAD) to highlight critical local feature details and effectively integrate them into global features. In the decoder, the adaptive feature aggregation (AFA) block was constructed for fusing high-level feature representations of different scales generated by the PVTv2-B3 encoder in a stepwise adaptive manner for refining global semantic information, while the ResidualBlock module was devised to mine detailed boundary cues disguised in low-level features. With the assistance of the selective global-to-local fusion head (SGLFH) module, the resulting boundary details were aggregated selectively with these global semantic features, strengthening these hierarchical features to cope with scale variations of polyps. The FCN branch embedded in the designed ResidualBlock module was used to encourage extraction of highly merged fine features to match the outputs of the Transformer branch into full-size segmentation maps. In this way, both branches were reciprocally influenced and complemented to enhance the discrimination capability of polyp features and enable a more accurate prediction of a full-size segmentation map. Extensive experiments on five challenging polyp segmentation benchmarks demonstrated that the proposed Dua-PSNet owned powerful learning and generalization ability and advanced the state-of-the-art segmentation performance among existing cutting-edge methods. These excellent results showed our Dua-PSNet had great potential to be a promising solution for practical polyp segmentation tasks in which wide variations of data typically occurred.

ASPS: Augmented Segment Anything Model for Polyp Segmentation

Integrating Spatial Prior Adapter for Enhancing SAM Performance in Medical Image Segmentation

Polyp-SAM: Transfer SAM for Polyp Segmentation

Can SAM Segment Polyps?

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

Segment Anything Model-guided Collaborative Learning Network for Scribble-supervised Polyp Segmentation

Polyp SAM 2: Advancing Zero shot Polyp Segmentation in Colorectal Cancer Detection

AGSAM: Agent-Guided Segment Anything Model for Automatic Segmentation in Few-Shot Scenarios

PP-SAM: Perturbed Prompts for Robust Adaptation of Segment Anything Model for Polyp Segmentation

Adaptive Context Selection for Polyp Segmentation

Self-Prompting Polyp Segmentation in Colonoscopy using Hybrid Yolo-SAM 2 Model

SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentation

AFANet: Adaptive Feature Aggregation for Polyp Segmentation

SAM-Path: A Segment Anything Model for Semantic Segmentation in Digital Pathology

UACENet: Uncertain Area Attention and Cross-Image Context Extraction Network for Polyp Segmentation.

MCICSAM: Monte Carlo-guided Interpolation Consistency Segment Anything Model for Semi-Supervised Prostate Zone Segmentation

Improved dual-aggregation polyp segmentation network combining a pyramid vision transformer with a fully convolutional network

Beyond Adapting SAM: Towards End-to-End Ultrasound Image Segmentation via Auto Prompting

Path-SAM2: Transfer SAM2 for digital pathology semantic segmentation

PropSAM: A Propagation-Based Model for Segmenting Any 3D Objects in Multi-Modal Medical Images

PSTNet: Enhanced Polyp Segmentation with Multi-scale Alignment and Frequency Domain Integration