Abstract:Renal tumors are one of the common diseases of urology, and precise segmentation of these tumors plays a crucial role in aiding physicians to improve diagnostic accuracy and treatment effectiveness. Nevertheless, inherent challenges associated with renal tumors, such as indistinct boundaries, morphological variations, and uncertainties in size and location, segmenting renal tumors accurately remains a significant challenge in the field of medical image segmentation. With the development of deep learning, substantial achievements have been made in the domain of medical image segmentation. However, existing models lack specificity in extracting features of renal tumors across different network hierarchies, which results in insufficient extraction of renal tumor features and subsequently affects the accuracy of renal tumor segmentation. To address this issue, we propose the Selective Kernel, Vision Transformer, and Coordinate Attention Enhanced U-Net (STC-UNet). This model aims to enhance feature extraction, adapting to the distinctive characteristics of renal tumors across various network levels. Specifically, the Selective Kernel modules are introduced in the shallow layers of the U-Net, where detailed features are more abundant. By selectively employing convolutional kernels of different scales, the model enhances its capability to extract detailed features of renal tumors across multiple scales. Subsequently, in the deeper layers of the network, where feature maps are smaller yet contain rich semantic information, the Vision Transformer modules are integrated in a non-patch manner. These assist the model in capturing long-range contextual information globally. Their non-patch implementation facilitates the capture of fine-grained features, thereby achieving collaborative enhancement of global–local information and ultimately strengthening the model's extraction of semantic features of renal tumors. Finally, in the decoder segment, the Coordinate Attention modules embedding positional information are proposed aiming to enhance the model's feature recovery and tumor region localization capabilities. Our model is validated on the KiTS19 dataset, and experimental results indicate that compared to the baseline model, STC-UNet shows improvements of 1.60%, 2.02%, 2.27%, 1.18%, 1.52%, and 1.35% in IoU, Dice, Accuracy, Precision, Recall, and F1-score, respectively. Furthermore, the experimental results demonstrate that the proposed STC-UNet method surpasses other advanced algorithms in both visual effectiveness and objective evaluation metrics.

Urtnet: an unstructured feature fusion network for real-time detection of endoscopic surgical instruments

SINet: A hybrid deep CNN model for real-time detection and segmentation of surgical instruments

Multi-level feature aggregation network for instrument identification of endoscopic images

Surgical Action and Instrument Detection Based on Multiscale Information Fusion

Attention-Guided Lightweight Network for Real-Time Segmentation of Robotic Surgical Instruments

RASNet: Segmentation for Tracking Surgical Instruments in Surgical Videos Using Refined Attention Segmentation Network

An Improved U-Net Infrared Small Target Detection Algorithm Based on Multi-Scale Feature Decomposition and Fusion and Attention Mechanism

PaI-Net: A Modified U-Net of Reducing Semantic Gap for Surgical Instrument Segmentation

MDF-Net: A Multi-Scale Dynamic Fusion Network for Breast Tumor Segmentation of Ultrasound Images

Real-time instance segmentation of surgical instruments using attention and multi-scale feature fusion

Ultrasound image segmentation of renal tumors based on UNet++ with fusion of multiscale residuals and dual attention

Inpainting surgical occlusion from laparoscopic video sequences for robot-assisted interventions

A parallel network utilizing local features and global representations for segmentation of surgical instruments

Dynamic Detection of Global Microfeatures in Multimodal Retinal Images

Instrument-tissue Interaction Detection Framework for Surgical Video Understanding

Toward Intraoperative Visual Intelligence: Real-Time Surgical Instrument Segmentation for Enhanced Surgical Monitoring

Multiscale Feature Extraction U-Net for Infrared Dim- and Small-Target Detection

Rethinking the unpretentious U-net for medical ultrasound image segmentation

STC-UNet: renal tumor segmentation based on enhanced feature extraction at different network levels

Deep Learning-Based Real-Time Ureter Identification in Laparoscopic Colorectal Surgery