Abstract:UNet has been highly successful in various medical image segmentation tasks, but the restricted field of perception of convolutional operations has led to the lack of UNet’s ability to explicitly model global context information. Vision Transformer captures global relevance through self-attention (SA), thus alleviating the problem of perceived wild locality in convolution neural network (CNN) architectures. However, traditional Transformer typically by means of SA with high computational complexity, and the fusion mechanism is static MLP mode, which is not efficient enough. In addition, the current segmentation methods usually perform simple feature fusion on the decoder side of the U-shaped architecture, which cannot meet the potential demand for important features when generating predictive maps. To solve these problems, we propose the E-TUNet network. On the one hand, we designed the Enhanced Transformer as the encoder by introducing EMSA and DynaMixer MLP. The Enhanced Transformer has high computational efficiency and dynamic mixing weights, which alleviates the problem of single static fusion mechanism. On the other hand, we introduce G-L MLP block with global-local space interaction capability to form hybrid cascaded upsampler for importance computation and matching of decoder side features. The hybrid cascaded upsampler has stronger information representation capabilities and effectively combines CNN and MLP to capture local and global dependencies. We demonstrate the effectiveness of our E-TUNet on two different public available datasets. Extensive experiments have shown that our method is highly competitive compared to other methods. In particular, on publicly available datasets (Synapse and ACDC), the mean DSC (%) is 82.15 and 91.12, respectively. HD95 (mm) is 17.89 on the Synapse dataset. E-TUNet has achieved significant performance improvement in multi-organ segmentation tasks, reaching a advanced level.

UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation

Mixed Transformer U-Net for Medical Image Segmentation

U-Net Transformer: Self and Cross Attention for Medical Image Segmentation

TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation

Multi-scale Neighborhood Attention Transformer on U-Net for Medical Image Segmentation.

TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation.

H2MaT-Unet:Hierarchical hybrid multi-axis transformer based Unet for medical image segmentation

3D TransUNet: Advancing Medical Image Segmentation through Vision Transformers

MaxViT-UNet: Multi-Axis Attention for Medical Image Segmentation

A Multi-Scale Cross-Fusion Medical Image Segmentation Network Based on Dual-Attention Mechanism Transformer

TSCA-Net: Transformer based spatial-channel attention segmentation network for medical images

UCTNet: Uncertainty-guided CNN-Transformer hybrid networks for medical image segmentation

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

Dual-attention transformer-based hybrid network for multi-modal medical image segmentation

ViT-UperNet: a hybrid vision transformer with unified-perceptual-parsing network for medical image segmentation

Sfe-Transunet: A Transformer-Based U-Net With Skipped Features Enhancer For Medical Image Segmentation

HmsU-Net: A hybrid multi-scale U-net based on a CNN and transformer for medical image segmentation

CiT-Net: Convolutional Neural Networks Hand in Hand with Vision Transformers for Medical Image Segmentation

Contextual Attention Network: Transformer Meets U-Net

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

Enhanced Transformer Encoder and Hybrid Cascaded Upsampler for Medical Image Segmentation.