Abstract:BackgroundU-Net and its variations have achieved remarkable performances in medical image segmentation. However, they have two limitations. First, the shallow layer feature of the encoder always contains background noise. Second, semantic gaps exist between the features of the encoder and the decoder. Skip-connections directly connect the encoder to the decoder, which will lead to the fusion of semantically dissimilar feature maps. PurposeTo overcome these two limitations, this paper proposes a novel medical image segmentation algorithm, called feature-guided attention network, which consists of U-Net, the cross-level attention filtering module (CAFM), and the attention-guided upsampling module (AUM). MethodsIn the proposed method, the AUM and the CAFM were introduced into the U-Net, where the AUM learns to filter the background noise in the low-level feature map of the encoder and the CAFM tries to eliminate the semantic gap between the encoder and the decoder. Specifically, the AUM adopts a top-down pathway to use the high-level feature map so as to filter the background noise in the low-level feature map of the encoder. The AUM uses the encoder features to guide the upsampling of the corresponding decoder features, thus eliminating the semantic gap between them. Four medical image segmentation tasks, including coronary atherosclerotic plaque segmentation (Dataset A), retinal vessel segmentation (Dataset B), skin lesion segmentation (Dataset C), and multiclass retinal edema lesions segmentation (Dataset D), were used to validate the proposed method. ResultsFor Dataset A, the proposed method achieved higher Intersection over Union (IoU) (67.91 +/- 3.82%$67.91\pm 3.82\%$), dice (79.39 +/- 3.37%$79.39\pm 3.37\%$), accuracy (98.39 +/- 0.34%$98.39\pm 0.34\%$), and sensitivity (85.10 +/- 3.74%$85.10\pm 3.74\%$) than the previous best method: CA-Net. For Dataset B, the proposed method achieved higher sensitivity (83.50%) and accuracy (97.55%) than the previous best method: SCS-Net. For Dataset C, the proposed method had highest IoU (83.47 +/- 0.41%$83.47\pm 0.41\%$) and dice (90.81 +/- 0.34%$90.81\pm 0.34\%$) than those of all compared previous methods. For Dataset D, the proposed method had highest dice (average: 81.53%; retina edema area [REA]: 83.78%; pigment epithelial detachment [PED] 77.13%), sensitivity (REA: 89.01%; SRF: 85.50%), specificity (REA: 99.35%; PED: 100.00), and accuracy (98.73%) among all compared previous networks. In addition, the number of parameters of the proposed method was 2.43 M, which is less than CA-Net (3.21 M) and CPF-Net (3.07 M). ConclusionsThe proposed method demonstrated state-of-the-art performance, outperforming other top-notch medical image segmentation algorithms. The CAFM filtered the background noise in the low-level feature map of the encoder, while the AUM eliminated the semantic gap between the encoder and the decoder. Furthermore, the proposed method was of high computational efficiency.

BUA-Net: Boundary and uncertainty-aware attention network for lumbar multi-region magnetic resonance imaging segmentation

Segmentation of Paraspinal Muscles at Varied Lumbar Spinal Levels by Explicit Saliency-Aware Learning

Multi-Scale Hybrid Attention Convolutional Neural Network for Automatic Segmentation of Lumbar Vertebrae From MRI

Boundary-Aware Network for Abdominal Multi-Organ Segmentation

BCAU-Net: A Novel Architecture with Binary Channel Attention Module for MRI Brain Segmentation.

A novel medical image segmentation approach by using multi-branch segmentation network based on local and global information synchronous learning

Attention Based Multi-Scale Nested Network for Biomedical Image Segmentation

Boundary Attention U-Net for Kidney and Kidney Tumor Segmentation.

Feature-guided Attention Network for Medical Image Segmentation.

Residual-atrous attention network for lumbosacral plexus segmentation with MR image

MAS-Net:multi-modal assistant segmentation network for lumbar intervertebral disc

MHA-Net: A Multibranch Hybrid Attention Network for Medical Image Segmentation

Accurate Segmentation of Lumbar Spine Magnetic Resonance Imaging by Deep Neural Network with Size-Adaptive Loss.

A sequential geometry-reconstruction-based deep learning approach to improve accuracy and consistence of lumbar spine MRI image segmentation

BCU-Net: Bridging ConvNeXt and U-Net for medical image segmentation

Multi-modality Hierarchical Fusion Network for Lumbar Spine Segmentation with Magnetic Resonance Images

MSA-unet: A Multiscale Lightweight U-net Lung CT Image Segmentation Algorithm Under Attention Mechanism

MLLA-UNet: Mamba-like Linear Attention in an Efficient U-Shape Model for Medical Image Segmentation

MRI Brain Tumour Segmentation Using Multiscale Attention U-Net

Boundary-aware context neural network for medical image segmentation

DBF-Net: A Dual-Branch Network with Feature Fusion for Ultrasound Image Segmentation