Abstract:Medical image segmentation, a crucial task in computer vision, facilitates the automated delineation of anatomical structures and pathologies, supporting clinicians in diagnosis, treatment planning, and disease monitoring. Notably, transformers employing shifted window-based self-attention have demonstrated exceptional performance. However, their reliance on local window attention limits the fusion of local and global contextual information, crucial for segmenting microtumors and miniature organs. To address this limitation, we propose the Adaptive Semantic Segmentation Network (ASSNet), a transformer architecture that effectively integrates local and global features for precise medical image segmentation. ASSNet comprises a transformer-based U-shaped encoder-decoder network. The encoder utilizes shifted window self-attention across five resolutions to extract multi-scale features, which are then propagated to the decoder through skip connections. We introduce an augmented multi-layer perceptron within the encoder to explicitly model long-range dependencies during feature extraction. Recognizing the constraints of conventional symmetrical encoder-decoder designs, we propose an Adaptive Feature Fusion (AFF) decoder to complement our encoder. This decoder incorporates three key components: the Long Range Dependencies (LRD) block, the Multi-Scale Feature Fusion (MFF) block, and the Adaptive Semantic Center (ASC) block. These components synergistically facilitate the effective fusion of multi-scale features extracted by the decoder while capturing long-range dependencies and refining object boundaries. Comprehensive experiments on diverse medical image segmentation tasks, including multi-organ, liver tumor, and bladder tumor segmentation, demonstrate that ASSNet achieves state-of-the-art results. Code and models are available at: \url{<a class="link-external link-https" href="https://github.com/lzeeorno/ASSNet" rel="external noopener nofollow">this https URL</a>}.

DS-MSFF-Net: Dual-path Self-Attention Multi-Scale Feature Fusion Network for CT Image Segmentation

mm3DSNet: multi-scale and multi-feedforward self-attention 3D segmentation network for CT scans of hepatobiliary ducts

DCFNet: An Effective Dual-Branch Cross-Attention Fusion Network for Medical Image Segmentation

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

FCSU-Net: A novel full-scale Cross-dimension Self-attention U-Net with collaborative fusion of multi-scale feature for medical image segmentation

Multi-Scale Convolution-Transformer Fusion Network for Endoscopic Image Segmentation.

Attention-enhanced multiscale feature fusion network for pancreas and tumor segmentation

MSF-Net: A Lightweight Multi-Scale Feature Fusion Network for Skin Lesion Segmentation

Multi-scale feature fusion network with local attention for lung segmentation

MFA-Net: Multi-Scale feature fusion attention network for liver tumor segmentation

CASF-Net: Cross-attention and Cross-scale Fusion Network for Medical Image Segmentation

AFFSegNet: Adaptive Feature Fusion Segmentation Network for Microtumors and Multi-Organ Segmentation

Multi-scale Feature Pyramid Fusion Network for Medical Image Segmentation

Attention-based dual-path feature fusion network for automatic skin lesion segmentation

Cervical Cancer Segmentation Based on Full-Scale Feature Fusion with Cascading-Attention and Dilated Convolution

Segmentation of medical images using an attention embedded lightweight network

Hybrid Attention Fusion Segmentation Network for Diffuse Large B-cell Lymphoma in PET-CT

DT-Net: A novel network based on multi-directional integrated convolution and threshold convolution

Context Fusion Network with Multi-Scale-aware Skip Connection and Twin-Split Attention for Liver Tumor Segmentation

AMCNet: Attention-Based Multiscale Convolutional Network for DCM MRI Segmentation

MASDF-Net: A Multi-Attention Codec Network with Selective and Dynamic Fusion for Skin Lesion Segmentation