Abstract:<p>Convolutional neural networks (CNNs) have been achieving remarkable results in medical image segmentation. However, for accurate segmentation of subcortical brain structure in MR images, it is still a challenge due to the ambiguous boundaries, the complex structures, and the various shapes, which limits their clinical application. In this paper, we focus on utilizing multi-scale image contexts and attention mechanisms to improve networks' ability to learn discriminative feature representation for accurate segmentation and present a novel FCNN architecture called multis-scale guided squeeze-and-excitation network (MSGSE-Net). In particular, we first propose the multi-scale guided squeeze-and-excitation (MSGSE) attention module which can progressively and selectively aggregate discriminative features. In contrast to existing attention modules, the MSGSE module performs an adaptive recalibration that features at different locations of the feature map are recalibrated under the guidance of multi-scale contexts. Then multi-scale spatial attention supervision is adopted to enhance the intra-class homogeneity and inter-class distinction of the attention weights. Moreover, we propose a novel entropy-weighted Dice loss (EDL) to force the network to focus on the ambiguous voxels around the boundaries of subcortical structures. We evaluate the proposed method on two challenging benchmark datasets (the IBSR dataset and the MALC dataset). The experimental results show that our model consistently yields better segmentation performance than several state-of-the-art methods and improves the segmentation Dice score by 1.6% at most compared with baseline method U-Net. Our code is available at<a href="http://https://github.com/neulxlx/MSGSE-Net">https://github.com/neulxlx/MSGSE-Net</a>.</p>

SEL-Net: a Multimodal Image Segmentation Method Based on Spatial Attention Mechanism

SSGNet: Selective Multi-Scale Receptive Field and Kernel Self-Attention Based on Group-Wise Modality for Brain Tumor Segmentation

Mmy-net: a Multimodal Network Exploiting Image and Patient Metadata for Simultaneous Segmentation and Diagnosis

Multimodal parallel attention network for medical image segmentation

A novel medical image segmentation approach by using multi-branch segmentation network based on local and global information synchronous learning

CM-SegNet: A Deep Learning-Based Automatic Segmentation Approach for Medical Images by Combining Convolution and Multilayer Perceptron

HybridCANet: UNet-like Network Bridging CNN and Attention for Multimodal Brain Image Segmentation.

Attention Based Multi-Scale Nested Network for Biomedical Image Segmentation

Multi-modal Brain Image Segmentation Based on Multi-Encoder with Hybrid Lateral Connection (Mehlc-Net).

Brain Tumor Image Segmentation Network Based on Dual Attention Mechanism.

Joint Attention for Medical Image Segmentation

U-Net Multi-Modality Glioma MRIs Segmentation Combined with Attention

A Novel Brain Tumor Segmentation Method Based on Im-proved Spatial Attention Mechanism and Multi-path Deep Neural Network

Multi-modal Brain Tumor Segmentation via Missing Modality Synthesis and Modality-level Attention Fusion

Serial Attention Network for Skin Lesion Segmentation

SUnet: A Multi-Organ Segmentation Network Based on Multiple Attention

PAMSNet: A medical image segmentation network based on spatial pyramid and attention mechanism

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

Accurate Whole-Brain Segmentation for Bimodal PET/MR Images Via a Cross-Attention Mechanism

GL-Segnet: Global-Local representation learning net for medical image segmentation

Multimodal Brain Tumor Segmentation Based on an Intelligent UNET-LSTM Algorithm in Smart Hospitals