Abstract:The UNet architecture, based on Convolutional Neural Networks (CNN), has demonstrated its remarkable performance in medical image analysis. However, it faces challenges in capturing long-range dependencies due to the limited receptive fields and inherent bias of convolutional operations. Recently, numerous transformer-based techniques have been incorporated into the UNet architecture to overcome this limitation by effectively capturing global feature correlations. However, the integration of the Transformer modules may result in the loss of local contextual information during the global feature fusion process. To overcome these challenges, we propose a 2D medical image segmentation model called Multi-scale Cross Perceptron Attention Network (MCPA). The MCPA consists of three main components: an encoder, a decoder, and a Cross Perceptron. The Cross Perceptron first captures the local correlations using multiple Multi-scale Cross Perceptron modules, facilitating the fusion of features across scales. The resulting multi-scale feature vectors are then spatially unfolded, concatenated, and fed through a Global Perceptron module to model global dependencies. Furthermore, we introduce a Progressive Dual-branch Structure to address the semantic segmentation of the image involving finer tissue structures. This structure gradually shifts the segmentation focus of MCPA network training from large-scale structural features to more sophisticated pixel-level features. We evaluate our proposed MCPA model on several publicly available medical image datasets from different tasks and devices, including the open large-scale dataset of CT (Synapse), MRI (ACDC), fundus camera (DRIVE, CHASE_DB1, HRF), and OCTA (ROSE). The experimental results show that our MCPA model achieves state-of-the-art performance. The code is available at <a class="link-external link-https" href="https://github.com/simonustc/MCPA-for-2D-Medical-Image-Segmentation" rel="external noopener nofollow">this https URL</a>.

HCMA-UNet: A Hybrid CNN-Mamba UNet with Inter-Slice Self-Attention for Efficient Breast Cancer Segmentation

VMC‐UNet: A Vision Mamba‐CNN U‐Net for Tumor Segmentation in Breast Ultrasound Image

Selective and Multi-Scale Fusion Mamba for Medical Image Segmentation

HMT-UNet: A hybird Mamba-Transformer Vision UNet for Medical Image Segmentation

Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentation

HAU-Net: Hybrid CNN-transformer for breast ultrasound image segmentation

HybridCANet: UNet-like Network Bridging CNN and Attention for Multimodal Brain Image Segmentation.

A Cross-attention and Multi-level Feature Fusion Network for Breast Lesion Segmentation in Ultrasound Images

A Hybrid Attentional Guidance Network for Tumors Segmentation of Breast Ultrasound Images.

MHA-Net: A Multibranch Hybrid Attention Network for Medical Image Segmentation

Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation

A mixed Mamba U-net for prostate segmentation in MR images

MCPA: Multi-scale Cross Perceptron Attention Network for 2D Medical Image Segmentation

A Breast Mass Image Segmentation Method Based on Improved UNet 3+ Network

HRCUNet: Hierarchical Region Contrastive Learning for Segmentation of Breast Tumors in DCE‐MRI

Large Window-based Mamba UNet for Medical Image Segmentation: Beyond Convolution and Self-attention

RM-UNet: UNet-like Mamba with Rotational SSM Module for Medical Image Segmentation

CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation

A Novel Method for Segmentation of Breast Masses Based on Mammography Images