Abstract:Background and Objective Medical image segmentation has garnered significant research attention in the neural network community as a fundamental requirement for developing intelligent medical assistant systems. A series of UNet-like networks with an encoder-decoder architecture have achieved remarkable success in medical image segmentation. Among these networks, UNet2+ (UNet++) and UNet3+ (UNet+++) have introduced redesigned skip connections, dense skip connections, and full-scale skip connections, respectively, surpassing the performance of the original UNet. However, UNet2+ lacks comprehensive information obtained from the entire scale, which hampers its ability to learn organ placement and boundaries. Similarly, due to the limited number of neurons in its structure, UNet3+ fails to effectively segment small objects when trained with a small number of samples. Method In this study, we propose UNet_sharp (UNet#), a novel network topology named after the "#" symbol, which combines dense skip connections and full-scale skip connections. In the decoder sub-network, UNet# can effectively integrate feature maps of different scales and capture fine-grained features and coarse-grained semantics from the entire scale. This approach enhances the understanding of organ and lesion positions and enables accurate boundary segmentation. We employ deep supervision for model pruning to accelerate testing and enable mobile device deployment. Additionally, we construct two classification-guided modules to reduce false positives and improve segmentation accuracy. Results Compared to current UNet-like networks, our proposed method achieves the highest Intersection over Union (IoU) values ((92.67±0.96)%, (92.38±1.29)%, (95.36±1.22)%, (74.01±2.03)%) and F1 scores ((91.64±1.86)%, (95.70±2.16)%, (97.34±2.76)%, (84.77±2.65)%) on the semantic segmentation tasks of nuclei, brain tumors, liver, and lung nodules, respectively. Conclusions The experimental results demonstrate that the reconstructed skip connections in UNet successfully incorporate multi-scale contextual semantic information. Compared to most state-of-the-art medical image segmentation models, our proposed method more accurately locates organs and lesions and precisely segments boundaries.

Multi-Scale TransUnet Combined with CBAM for Nuclear Image Segmentation.

Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image

TransNuSeg: A Lightweight Multi-Task Transformer for Nuclei Segmentation

MTC-TransUNet: A Multi-Scale Mixed Convolution TransUNet for Medical Image Segmentation

DSCA-Net: Double-stage Codec Attention Network for automatic nuclear segmentation

BiFTransNet: A unified and simultaneous segmentation network for gastrointestinal images of CT & MRI

FRE-Net: Full-region enhanced network for nuclei segmentation in histopathology images

Medical image segmentation with UNet-based multi-scale context fusion

HCT-Unet: multi-target medical image segmentation via a hybrid CNN-transformer Unet incorporating multi-axis gated multi-layer perceptron

2MSPK-Net: A nuclei segmentation network based on multi-scale, multi-dimensional attention, and SAM prior knowledge

MGTUNet: An new UNet for colon nuclei instance segmentation and quantification

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

Multi-scale context UNet-like network with redesigned skip connections for medical image segmentation

Optimization of segmentation model based on maximization information fusion and its application in nuclear image analysis

A Hybrid-Attention Nested UNet for Nuclear Segmentation in Histopathological Images

Nuclei Segmentation Using Cascaded Bilateral Attention U-Net.

Dual U-Net for the Segmentation of Overlapping Glioma Nuclei.

NVTrans-UNet: Neighborhood vision transformer based U-Net for multi-modal cardiac MR image segmentation

MoE-NuSeg: Enhancing Nuclei Segmentation in Histology Images with a Two-Stage Mixture of Experts Network

Nuclear Segmentation in Histopathological Images Using Two-Stage Stacked U-Nets With Attention Mechanism

[Multi-scale medical image segmentation based on pixel encoding and spatial attention mechanism]