Abstract:As an essential prerequisite for developing a medical intelligent assistant system, medical image segmentation has received extensive research and concentration from the neural network community. A series of UNet-like networks with encoder-decoder architecture has achieved extraordinary success, in which UNet2+ and UNet3+ redesign skip connections, respectively proposing dense skip connection and full-scale skip connection and dramatically improving compared with UNet in medical image segmentation. However, UNet2+ lacks sufficient information explored from the full scale, which will affect the learning of organs' location and boundary. Although UNet3+ can obtain the full-scale aggregation feature map, owing to the small number of neurons in the structure, it does not satisfy the segmentation of tiny objects when the number of samples is small. This paper proposes a novel network structure combining dense skip connections and full-scale skip connections, named UNet-sharp (UNet\#) for its shape similar to symbol \#. The proposed UNet\# can aggregate feature maps of different scales in the decoder sub-network and capture fine-grained details and coarse-grained semantics from the full scale, which benefits learning the exact location and accurately segmenting the boundary of organs or lesions. We perform deep supervision for model pruning to speed up testing and make it possible for the model to run on mobile devices; furthermore, designing two classification-guided modules to reduce false positives achieves more accurate segmentation results. Various experiments of semantic segmentation and instance segmentation on different modalities (EM, CT, MRI) and dimensions (2D, 3D) datasets, including the nuclei, brain tumor, liver, and lung, demonstrate that the proposed method outperforms state-of-the-art models.

Architectures and Applications of U-net in Medical Image Segmentation: A Review

Medical Image Segmentation Based on U-Net: A Review

U-Net-Based Medical Image Segmentation

U-Net and Its Variants for Medical Image Segmentation: A Review of Theory and Applications

Research on U-Net Medical Image Segmentation

U-Net and its variants for medical image segmentation: theory and applications

Medical Image Segmentation Review: The success of U-Net

U-Net in Medical Image Segmentation: A Review of Its Applications Across Modalities

U-Net and its variants for Medical Image Segmentation : A short review

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

A survey on U-shaped networks in medical image segmentations

Review of U-Net-Based Convolutional Neural Networks for Breast Medical Image Segmentation

UNet#: A UNet-like Redesigning Skip Connections for Medical Image Segmentation

DC-UNet: Rethinking the U-Net Architecture with Dual Channel Efficient CNN for Medical Images Segmentation

A State-of-the-art Survey of U-Net in Microscopic Image Analysis: from Simple Usage to Structure Mortification

UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation

A Review of Medical Ocular Image Segmentation

DCSAU-Net: A deeper and more compact split-attention U-Net for medical image segmentation

Two‐dimensional medical image segmentation based on U‐shaped structure

Context-Based Deep Residual Learning for Medical Image Segmentation

Residual-Attention UNet++: A Nested Residual-Attention U-Net for Medical Image Segmentation