Abstract:In the early prevention stage of colorectal cancer (CRC), the utilization of automatic polyp segmentation techniques from colonoscopy images has demonstrated efficacy in mitigating the misdiagnosis rate. Nonetheless, accurate polyp segmentation is always against with various challenges, including the presence of inconsistent size and morphological changes within polyp classes, limited interclass contrast, and high levels of interference. In recent years, much methodologies based on convolutional neural networks (CNNs) have been widely introduced to enhance the precision of polyp segmentation. However, two significant hurdles persist: 1) these methods frequently suffer from an inadequate acquisition of contextual features, causing insufficient feature representation and 2) there is a deficiency in recognizing intricate information, such as precise polyp boundaries. Addressing these issues, this article introduces a novel dual-branch multiattention network, denoted as DBMA-Net. Specifically, proposed DBMA-Net primarily introduces a dual-encoding path that combines CNN and Transformer-based approaches to enrich feature representation. Additionally, an attention-based fusion module (AFM) is incorporated between the dual-encoding path, aimed at optimizing features by supplementing local information with global insights. Subsequently, two distinct attention mechanisms are introduced to enhance features: the attention-based enhancement module (AEM) and the multiview attention module (MAM), to acquire stronger local features. These modules serve to enrich the finer details while extensively exploring and enhancing the lesion region, thereby further elevating segmentation accuracy. Following the above feature optimization, the enhanced feature maps are hierarchically integrated across multiple scales based on the proposed multiscale feature integration module (MFIM) for accurate feature reconstruction. This strategy not only curtails feature loss but also aids in restoring feature resolution. Ultimately, comprehensive experiments, including comparative and ablation studies across various datasets, validate the superior segmentation performance of the proposed network compared to most state-of-the-art (SOTA) models.

MSNet: a novel network with comprehensive multi-scale feature integration for gastric cancer and colon polyp segmentation

Automatic Polyp Segmentation Via Multi-scale Subtraction Network

DBMA-Net: A Dual-Branch Multiattention Network for Polyp Segmentation

MCSF-Net: a multi-scale channel spatial fusion network for real-time polyp segmentation

ECTransNet: An Automatic Polyp Segmentation Network Based on Multi-scale Edge Complementary

Multi-scale boundary neural network for gastric tumor segmentation

Multi-Scale Context-Guided Deep Network for Automated Lesion Segmentation With Endoscopy Images of Gastrointestinal Tract

M$^{2}$SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation

Multi‐scale nested UNet with transformer for colorectal polyp segmentation

Multi-Dimensional Fusion Reverse Attention Network for Polyp Segmentation

MugenNet: A Novel Combined Convolution Neural Network and Transformer Network with its Application for Colonic Polyp Image Segmentation

EMS-Net: Enhanced Multi-Scale Network for Polyp Segmentation

2MGAS-Net: multi-level multi-scale gated attentional squeezed network for polyp segmentation

MSI-UNet: A Flexible UNet-Based Multi-Scale Interactive Framework for 3D Gastric Tumor Segmentation on CT Scans

MGF-net: Multi-channel group fusion enhancing boundary attention for polyp segmentation.

MSBC-Net: Automatic rectal cancer segmentation from MR scans

MSSA‐Net: A novel multi‐scale feature fusion and global self‐attention network for lesion segmentation

AugMS-Net:Augmented Multiscale Network for Small Cervical Tumor Segmentation from MRI Volumes

Simple and robust depth-wise cascaded network for polyp segmentation

MS-TCNet: An effective Transformer–CNN combined network using multi-scale feature learning for 3D medical image segmentation

CoAM-Net: Coordinate Asymmetric Multi-Scale Fusion Strategy for Polyp Segmentation