Abstract:Accurate and reliable segmentation of colorectal polyps is important for the diagnosis and treatment of colorectal cancer. Most of the existing polyp segmentation methods innovatively combine CNN with Transformer. Due to the single combination approach, there are limitations in establishing connections between local feature information and utilizing global contextual information captured by Transformer. Still not a better solution to the problems in polyp segmentation. In this paper, we propose a Dual Branch Multiscale Feature Fusion Network for Polyp Segmentation, abbreviated as DBMF, for polyp segmentation to achieve accurate segmentation of polyps. DBMF uses CNN and Transformer in parallel to extract multi-scale local information and global contextual information respectively, with different regions and levels of information to make the network more accurate in identifying polyps and their surrounding tissues. Feature Super Decoder (FSD) fuses multi-level local features and global contextual information in dual branches to fully exploit the potential of combining CNN and Transformer to improve the network's ability to parse complex scenes and the detection rate of tiny polyps. The FSD generates an initial segmentation map to guide the second parallel decoder (SPD) to refine the segmentation boundary layer by layer. SPD consists of a multi-scale feature aggregation module (MFA) and parallel polarized self-attention (PSA) and reverse attention fusion modules (RAF). MFA aggregates multi-level local feature information extracted by CNN Brach to find consensus regions between multiple scales and improve the network's ability to identify polyp regions. PSA uses dual attention to enhance the fine-grained nature of segmented regions and reduce the redundancy introduced by MFA and interference information. RAF mines boundary cues and establishes relationships between regions and boundary cues. The three RAFs guide the network to explore lost targets and boundaries in a bottom-up manner. We used the CVC-ClinicDB, Kvasir, CVC-300, CVC-ColonDB, and ETIS datasets to conduct comparison experiments and ablation experiments between DBMF and mainstream polyp segmentation networks. The results showed that DBMF outperformed the current mainstream networks on five benchmark datasets.

DEMF-Net: A dual encoder multi-scale feature fusion network for polyp segmentation

Multi-Dimensional Fusion Reverse Attention Network for Polyp Segmentation

Multi-level feature fusion network combining attention mechanisms for polyp segmentation

MCSF-Net: a multi-scale channel spatial fusion network for real-time polyp segmentation

CoAM-Net: Coordinate Asymmetric Multi-Scale Fusion Strategy for Polyp Segmentation

DBMF: Dual Branch Multiscale Feature Fusion Network for polyp segmentation

Dual‐branch feature extraction network combined with Transformer and CNN for polyp segmentation

UMF-Net: A UNet-based Multi-Branch Feature Fusion Network for Colon Polyp Segmentation

FTMF-Net: A Fourier Transform-Multiscale Feature Fusion Network for Segmentation of Small Polyp Objects.

CAFE-Net: Cross-Attention and Feature Exploration Network for polyp segmentation

DSFNet: Dual-GCN and Location-fused Self-attention with Weighted Fast Normalized Fusion for Polyps Segmentation

WDFF-Net: Weighted Dual-branch Feature Fusion Network for Polyp Segmentation with Object-aware Attention Mechanism

Dual-Domain Feature Interaction Network for Automatic Colorectal Polyp Segmentation

Polyp Segmentation Network with Hybrid Channel-Spatial Attention and Pyramid Global Context Guided Feature Fusion

C 2 E-Net: Cascade attention and context-aware cross-level fusion network via edge learning guidance for polyp segmentation

A Segmentation Algorithm of Colonoscopy Images Based on Multi-Scale Feature Fusion

DBMA-Net: A Dual-Branch Multiattention Network for Polyp Segmentation

FMCA-Net: A feature secondary multiplexing and dilated convolutional attention polyp segmentation network based on pyramid vision transformer

Edge-aware Feature Aggregation Network for Polyp Segmentation

Colorectal Polyp Segmentation by U-Net with Dilation Convolution

Automated polyp segmentation based on a multi-distance feature dissimilarity-guided fully convolutional network