Abstract:Deep learning architectures based on convolutional neural network (CNN) and Transformer have achieved great success in medical image segmentation. Models based on the encoder-decoder framework like U-Net have been successfully employed in many realistic scenarios. However, due to the low contrast between object and background, various shapes and scales of objects, and complex background in medical images, it is difficult to locate targets and obtain better segmentation performance by extracting effective information from images. In this paper, an encoder-decoder architecture based on spatial and channel attention modules built by Transformer is proposed for medical image segmentation. Concretely, spatial and channel attention modules based on Transformer are utilized to extract spatial and channel global complementary information at different layers in U-shape network, which is beneficial to learn the detail features in different scales. To fuse better spatial and channel information from Transformer features, a spatial and channel feature fusion block is designed for the decoder. The proposed network inherits the advantages of both CNN and Transformer with the local feature representation and long-range dependency for medical images. Qualitative and quantitative experiments demonstrate that the proposed method outperforms against eight state-of-the-art segmentation methods on five publicly medical image datasets including different modalities, such as 80.23% and 93.56% Dice value, 67.13% and 88.94% Intersection over Union (IoU) value on the Multi-organ Nucleus Segmentation (MoNuSeg) and Combined Healthy Abdominal Organ Segmentation with Computed Tomography scans (CHAOS-CT) datasets.

Medical Image Segmentation Based on Dynamic Positioning and Region-Aware Attention

DRA-Net: Medical image segmentation based on adaptive feature extraction and region-level information fusion

Dual Attention Encoder with Joint Preservation for Medical Image Segmentation

DAPFormer: Dual-Attention and Pyramid-Aware Network for Medical Image Segmentation

Multi-dimension Transformer with Attention-based Filtering for Medical Image Segmentation

TransDAE: Dual Attention Mechanism in a Hierarchical Transformer for Efficient Medical Image Segmentation

HMDA: A Hybrid Model with Multi-scale Deformable Attention for Medical Image Segmentation

Dual-attention transformer-based hybrid network for multi-modal medical image segmentation

A Dynamic Cross-Scale Transformer with Dual-Compound Representation for 3D Medical Image Segmentation

EPT-Net: Edge Perception Transformer for 3D Medical Image Segmentation

Parameter-Efficient Transformer with Hybrid Axial-Attention for Medical Image Segmentation

HCA-former: Hybrid Convolution Attention Transformer for 3D Medical Image Segmentation

Slimmable transformer with hybrid axial-attention for medical image segmentation

TSCA-Net: Transformer based spatial-channel attention segmentation network for medical images

PHTrans: Parallelly Aggregating Global and Local Representations for Medical Image Segmentation

PHTrans: Parallelly Aggregating Global and Local Representations for Medical Image Segmentation

A Improved Spatial-Reduction Attention Transformer for Medical Image Segmentation

H2Former: An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation

STA-Former: enhancing medical image segmentation with Shrinkage Triplet Attention in a hybrid CNN-Transformer model

Pyramid Medical Transformer for Medical Image Segmentation

DS-Former: A Dual-Stream Encoding-Based Transformer for 3D Medical Image Segmentation