Abstract:BackgroundU-Net and its variations have achieved remarkable performances in medical image segmentation. However, they have two limitations. First, the shallow layer feature of the encoder always contains background noise. Second, semantic gaps exist between the features of the encoder and the decoder. Skip-connections directly connect the encoder to the decoder, which will lead to the fusion of semantically dissimilar feature maps. PurposeTo overcome these two limitations, this paper proposes a novel medical image segmentation algorithm, called feature-guided attention network, which consists of U-Net, the cross-level attention filtering module (CAFM), and the attention-guided upsampling module (AUM). MethodsIn the proposed method, the AUM and the CAFM were introduced into the U-Net, where the AUM learns to filter the background noise in the low-level feature map of the encoder and the CAFM tries to eliminate the semantic gap between the encoder and the decoder. Specifically, the AUM adopts a top-down pathway to use the high-level feature map so as to filter the background noise in the low-level feature map of the encoder. The AUM uses the encoder features to guide the upsampling of the corresponding decoder features, thus eliminating the semantic gap between them. Four medical image segmentation tasks, including coronary atherosclerotic plaque segmentation (Dataset A), retinal vessel segmentation (Dataset B), skin lesion segmentation (Dataset C), and multiclass retinal edema lesions segmentation (Dataset D), were used to validate the proposed method. ResultsFor Dataset A, the proposed method achieved higher Intersection over Union (IoU) (67.91 +/- 3.82%$67.91\pm 3.82\%$), dice (79.39 +/- 3.37%$79.39\pm 3.37\%$), accuracy (98.39 +/- 0.34%$98.39\pm 0.34\%$), and sensitivity (85.10 +/- 3.74%$85.10\pm 3.74\%$) than the previous best method: CA-Net. For Dataset B, the proposed method achieved higher sensitivity (83.50%) and accuracy (97.55%) than the previous best method: SCS-Net. For Dataset C, the proposed method had highest IoU (83.47 +/- 0.41%$83.47\pm 0.41\%$) and dice (90.81 +/- 0.34%$90.81\pm 0.34\%$) than those of all compared previous methods. For Dataset D, the proposed method had highest dice (average: 81.53%; retina edema area [REA]: 83.78%; pigment epithelial detachment [PED] 77.13%), sensitivity (REA: 89.01%; SRF: 85.50%), specificity (REA: 99.35%; PED: 100.00), and accuracy (98.73%) among all compared previous networks. In addition, the number of parameters of the proposed method was 2.43 M, which is less than CA-Net (3.21 M) and CPF-Net (3.07 M). ConclusionsThe proposed method demonstrated state-of-the-art performance, outperforming other top-notch medical image segmentation algorithms. The CAFM filtered the background noise in the low-level feature map of the encoder, while the AUM eliminated the semantic gap between the encoder and the decoder. Furthermore, the proposed method was of high computational efficiency.

Caln: Channel Attention LSTM Network for Pituitary Segmentation in Dynamic Contrast-Enhanced MRI

PDC-Net: Parallel Dilated Convolutional Network with Channel Attention Mechanism for Pituitary Adenoma Segmentation.

DAAM-Net: A dual-encoder U-Net network with adjacent auxiliary module for pituitary tumor and jaw cyst segmentation

HMRNet: High and Multi-Resolution Network With Bidirectional Feature Calibration for Brain Structure Segmentation in Radiotherapy

Attention Based Multi-Scale Nested Network for Biomedical Image Segmentation

SCAU-Net: Spatial-Channel Attention U-Net for Gland Segmentation.

TSCA-Net: Transformer based spatial-channel attention segmentation network for medical images

HybridCANet: UNet-like Network Bridging CNN and Attention for Multimodal Brain Image Segmentation.

HD 2 A-Net: A novel dual gated attention network using comprehensive hybrid dilated convolutions for medical image segmentation

Feature-guided Attention Network for Medical Image Segmentation.

HAD-Net: an Attention U-based Network with Hyper-Scale Shifted Aggregating and Max-Diagonal Sampling for Medical Image Segmentation

GCT-UNET: U-Net Image Segmentation Model for a Small Sample of Adherent Bone Marrow Cells Based on a Gated Channel Transform Module

Brain tumor image segmentation method using hybrid attention module and improved mask RCNN

Prior Attention Network for Multi-Lesion Segmentation in Medical Images

MSGSE-Net: Multi-scale guided squeeze-and-excitation network for subcortical brain structure segmentation

CANet: Channel Extending and Axial Attention Catching Network for Multi-structure Kidney Segmentation

Learning U-Net Based Multi-Scale Features in Encoding-Decoding for MR Image Brain Tissue Segmentation.

Brain tumor magnetic resonance image segmentation by a multiscale contextual attention module combined with a deep residual UNet (MCA-ResUNet)

AMCNet: Attention-Based Multiscale Convolutional Network for DCM MRI Segmentation

Attention-modulated Multi-Branch Convolutional Neural Networks for Neonatal Brain Tissue Segmentation

A Multi-scale Attention Network for Kidney Tumor Segmentation on CT Scans