Abstract:The advanced development of deep learning methods has recently made significant improvements in medical image segmentation. Encoder–decoder networks, such as U-Net, have addressed some of the challenges in medical image segmentation with an outstanding performance, which has promoted them to be the most dominating deep learning architecture in this domain. Despite their outstanding performance, we argue that they still lack some aspects. First, there is incompatibility in U-Net’s skip connection between the encoder and decoder features due to the semantic gap between low-processed encoder features and highly processed decoder features, which adversely affects the final prediction. Second, it lacks capturing multi-scale context information and ignores the contribution of all semantic information through the segmentation process. Therefore, we propose a model named MDA-Unet, a novel multi-scale deep learning segmentation model. MDA-Unet improves upon U-Net and enhances its performance in segmenting medical images with variability in the shape and size of the region of interest. The model is integrated with a multi-scale spatial attention module, where spatial attention maps are derived from a hybrid hierarchical dilated convolution module that captures multi-scale context information. To ease the training process and reduce the gradient vanishing problem, residual blocks are deployed instead of the basic U-net blocks. Through a channel attention mechanism, the high-level decoder features are used to guide the low-level encoder features to promote the selection of meaningful context information, thus ensuring effective fusion. We evaluated our model on 2 different datasets: a lung dataset of 2628 axial CT images and an echocardiographic dataset of 2000 images, each with its own challenges. Our model has achieved a significant gain in performance with a slight increase in the number of trainable parameters in comparison with the basic U-Net model, providing a dice score of 98.3% on the lung dataset and 96.7% on the echocardiographic dataset, where the basic U-Net has achieved 94.2% on the lung dataset and 93.9% on the echocardiographic dataset.

MSR-UNet: enhancing multi-scale and long-range dependencies in medical image segmentation

Mixed Transformer U-Net for Medical Image Segmentation

[Multi-scale medical image segmentation based on pixel encoding and spatial attention mechanism]

DMSA-UNet: Dual Multi-Scale Attention makes UNet more strong for medical image segmentation

MSVM-UNet: Multi-Scale Vision Mamba UNet for Medical Image Segmentation

MCPA: Multi-scale Cross Perceptron Attention Network for 2D Medical Image Segmentation

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

MSRD-Unet: Multiscale Residual Dilated U-Net for Medical Image Segmentation

Multi-scale Neighborhood Attention Transformer on U-Net for Medical Image Segmentation.

MSAANet: Multi-scale Axial Attention Network for Medical Image Segmentation.

MCA-UNet: multi-scale cross co-attentional U-Net for automatic medical image segmentation

A Multiscale Attentional Unet Model for Automatic Segmentation in Medical Ultrasound Images.

Multiscale Transunet + + : Dense Hybrid U-Net with Transformer for Medical Image Segmentation

TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation.

MH UNet: A Multi-Scale Hierarchical Based Architecture for Medical Image Segmentation

Multiresolution Aggregation Transformer UNet Based on Multiscale Input and Coordinate Attention for Medical Image Segmentation

MS-UNet: Multi-Scale Nested UNet for Medical Image Segmentation with Few Training Data Based on an ELoss and Adaptive Denoising Method

MSA$^2$Net: Multi-scale Adaptive Attention-guided Network for Medical Image Segmentation

MDA-Unet: A Multi-Scale Dilated Attention U-Net for Medical Image Segmentation

A Multi-Scale Cross-Fusion Medical Image Segmentation Network Based on Dual-Attention Mechanism Transformer

W-Net: Dual Supervised Medical Image Segmentation Model with Multi-Dimensional Attention and Cascade Multi-Scale Convolution