Abstract:Objectives: Accurate extraction of regions of interest (ROI) with variable shapes and scales is one of the primary challenges in medical image segmentation. Current U-based networks mostly aggregate multi-stage encoding outputs as an improved multi-scale skip connection. Although this design has been proven to provide scale diversity and contextual integrity, there remain several intuitive limits: (i) the encoding outputs are resampled to the same size simply, which destruct the fine-grained information. The advantages of utilization of multiple scales are insufficient. (ii) Certain redundant information proportional to the feature dimension size is introduced and causes multi-stage interference. And (iii) the precision of information delivery relies on the up-sampling and down-sampling layers, but guidance on maintaining consistency in feature locations and trends between them is lacking. Methods: To improve these situations, this paper proposed a U-based CNN network named HAD-Net, by assembling a new hyper-scale shifted aggregating module (HSAM) paradigm and progressive reusing attention (PRA) for skip connections, as well as employing a novel pair of dual-branch parameter-free sampling layers, i.e. max-diagonal pooling (MDP) and max-diagonal un-pooling (MDUP). That is, the aggregating scheme additionally combines five subregions with certain offsets in the shallower stage. Since the lower scale-down ratios of subregions enrich scales and fine-grain context. Then, the attention scheme contains a partial-to-global channel attention (PGCA) and a multi-scale reusing spatial attention (MRSA), it builds reusing connections internally and adjusts the focus on more useful dimensions. Finally, MDP and MDUP are explored in pairs to improve texture delivery and feature consistency, enhancing information retention and avoiding positional confusion. Results: Compared to state-of-the-art networks, HAD-Net has achieved comparable and even better performances with Dice of 90.13%, 81.51%, and 75.43% for each class on BraTS20, 89.59% Dice and 98.56% AUC on Kvasir-SEG, as well as 82.17% Dice and 98.05% AUC on DRIVE. Conclusions: The scheme of HSAM+PRA+MDP+MDUP has been proven to be a remarkable improvement and leaves room for further research.

Attention-enriched Deeper UNet (ADU-NET) for Disease Diagnosis in Breast Ultrasound and Retina Fundus Images

A Multi-Scale Residual Attention Network for Retinal Vessel Segmentation

DAU-Net: Dual attention-aided U-Net for segmenting tumor in breast ultrasound images

A Unified 2D Medical Image Segmentation Network (segmentnet) Through Distance-Awareness and Local Feature Extraction

DDRA-Net: Dual-Channel Deep Residual Attention UPerNet for Breast Lesions Segmentation in Ultrasound Images

Attention gate and dilation U-shaped network (GDUNet): an efficient breast ultrasound image segmentation network with multiscale information extraction

Rethinking the unpretentious U-net for medical ultrasound image segmentation

AAU-Net: An Adaptive Attention U-Net for Breast Lesions Segmentation in Ultrasound Images

ECU-Net: multi-scale salient boundary detection and contrast feature enhancement U-Net for breast ultrasound image segmentation

DDU-Net: A dual dense U-structure network for medical image segmentation

An RDAU-NET model for lesion segmentation in breast ultrasound images

PAM-UNet: Shifting Attention on Region of Interest in Medical Images

HAD-Net: an Attention U-based Network with Hyper-Scale Shifted Aggregating and Max-Diagonal Sampling for Medical Image Segmentation

Hybrid dilation and attention residual U-Net for medical image segmentation

AttResDU-Net: Medical Image Segmentation Using Attention-based Residual Double U-Net

MD-UNet: a medical image segmentation network based on mixed depthwise convolution

DCSAU-Net: A deeper and more compact split-attention U-Net for medical image segmentation

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

DGFAU-Net: Global feature attention upsampling network for medical image segmentation

WATUNet: A Deep Neural Network for Segmentation of Volumetric Sweep Imaging Ultrasound

Ultrasound image segmentation of renal tumors based on UNet++ with fusion of multiscale residuals and dual attention