Abstract:Background Developing deep learning models for segmenting medical images in multiple modalities with less data and annotation is an attractive and challenging task, which was previously discussed as being accomplished by complex external frameworks for bridging the gap between different modalities. Exploring the generalization ability of networks in medical images in different modalities could provide more simple and accessible methods, yet comprehensive testing could still be needed. Purpose To explore the feasibility and robustness of using computed tomography (CT) images to assist the segmentation of magnetic resonance (MR) images via the generalization, in the segmentation of renal parenchyma of renal cell carcinoma (RCC) patients. Methods Nephrographic CT images and fat‐suppressed T2‐weighted (fs‐T2 W) images were retrospectively collected. The pure CT dataset included 116 CT images. Additionally, 240 MR images were randomly divided into subsets A and B. From subset A, three training datasets were constructed, each containing 40, 80, and 120 images, respectively. Similarly, three datasets were constructed from subset B. Subsequently, datasets with mixed modality were created by combining these pure MR datasets with the 116 CT images. The 3D‐UNET models for segmenting the renal parenchyma in two steps were trained using these 13 datasets: segmenting kidneys and then the renal parenchyma. These models were evaluated in internal MR (n = 120), CT (n = 65) validation datasets, and an external validation dataset of CT (n = 79), using the mean of the dice similarity coefficient (DSC). To demonstrate the robustness of generalization ability over different proportions of modalities, we compared the models trained with mixed modality in three different proportions and pure MR, using repeated measures analysis of variance (RM‐ANOVA). We developed a renal parenchyma volume quantification tool by the trained models. The mean differences and Pearson correlation coefficients between the model segmentation volume and the ground truth segmentation volume were calculated for its evaluation. Results The mean DSCs of models trained with 116 data in CT in the validation of MR were 0.826, 0.842, and 0.953, respectively, for the predictions of kidney segmentation model on whole image, renal parenchymal segmentation model on kidneys with RCC and without RCC. For all models trained with mixed modality, the means of DSC were above 0.9, in all validations of CT and MR. According to the results of the comparison between models trained with mixed modality and pure MR, the means of DSC of the former were significantly greater or equal to the latter, at all three different proportions of modalities. The differences of volumes were all significantly lower than one‐third of the volumetric quantification error of a previous method, and the Pearson correlation coefficients of volumes were all above 0.96 on kidneys with and without RCC of three validations. Conclusion CT images could be used to assist the segmentation of MR images via the generalization, with or without the supervision of MR data. This ability showed acceptable robustness. A tool for accurately measuring renal parenchymal volume on CT and MR images was established.

Dempster-Shafer Evidence Theory-Based Cv Model for Renal Lesion Segmentation of Medical Ultrasound Images

Improved Evidential Fuzzy C-Means Method

Automatic Renal Lesion Segmentation in Ultrasound Images Based on Saliency Features, Improved LBP, and an Edge Indicator under Level Set Framework

Ultrasound image segmentation of renal tumors based on UNet++ with fusion of multiscale residuals and dual attention

CP-UNet: Contour-based Probabilistic Model for Medical Ultrasound Images Segmentation

[Kidney Tumor Segmentation in Ultrasound Images Using Adaptive Sub-Regional Evolution Level Set Models].

A medical image segmentation method for rectal tumors based on multi‐scale feature retention and multiple attention mechanisms

MRI texture-based machine learning models for the evaluation of renal function on different segmentations: a proof-of-concept study

Transformative Deep Neural Network Approaches in Kidney Ultrasound Segmentation: Empirical Validation with an Annotated Dataset

Advances in Kidney Biopsy Lesion Assessment through Dense Instance Segmentation

CNN-based automatic segmentations and radiomics feature reliability on contrast-enhanced ultrasound images for renal tumors

Kidney segmentation from DCE-MRI converging level set methods, fuzzy clustering and Markov random field modeling

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

Reliable segmentation of multiple lesions from medical images

A Self-Supervised Strategy for Fully Automatic Segmentation of Renal Dynamic Contrast-Enhanced Magnetic Resonance Images.

Intelligent contour extraction approach for accurate segmentation of medical ultrasound images

Using CT images to assist the segmentation of MR images via generalization: Segmentation of the renal parenchyma of renal carcinoma patients

The Segmentation of Multiple Types of Uterine Lesions in Magnetic Resonance Images Using a Sequential Deep Learning Method with Image-Level Annotations

Simultaneous Image Reconstruction and Lesion Segmentation in Accelerated MRI Using Multitasking Learning.

An efficient framework for lesion segmentation in ultrasound images using global adversarial learning and region-invariant loss

URCA: Uncertainty-based region clipping algorithm for semi-supervised medical image segmentation