Abstract:PURPOSE: Automatic and accurate segmentation of lesions in images of metastatic castration-resistant prostate cancer has the potential to enable personalized radiopharmaceutical therapy and advanced treatment response monitoring. The aim of this study is to develop a convolutional neural networks-based framework for fully-automated detection and segmentation of metastatic prostate cancer lesions in whole-body PET/CT images.METHODS: 525 whole-body PET/CT images of patients with metastatic prostate cancer were available for the study, acquired with the [18F]DCFPyL radiotracer that targets prostate-specific membrane antigen (PSMA). U-Net (1)-based convolutional neural networks (CNNs) were trained to identify lesions on paired axial PET/CT slices. Baseline models were trained using batch-wise dice loss, as well as the proposed weighted batch-wise dice loss (wDice), and the lesion detection performance was quantified, with a particular emphasis on lesion size, intensity, and location. We used 418 images for model training, 30 for model validation, and 77 for model testing. In addition, we allowed our model to take n = 0,2, …, 12 neighboring axial slices to examine how incorporating greater amounts of 3D context influences model performance. We selected the optimal number of neighboring axial slices that maximized the detection rate on the 30 validation images, and trained five neural networks with different architectures.RESULTS: Model performance was evaluated using the detection rate, Dice similarity coefficient (DSC) and sensitivity. We found that the proposed wDice loss significantly improved the lesion detection rate, lesion-wise DSC and lesion-wise sensitivity compared to the baseline, with corresponding average increases of 0.07 (p-value = 0.01), 0.03 (p-value = 0.01) and 0.04 (p-value = 0.01), respectively. The inclusion of the first two neighboring axial slices in the input likewise increased the detection rate by 0.17, lesion-wise DSC by 0.05, and lesion-wise mean sensitivity by 0.16. However, there was a minimal effect from including more distant neighboring slices. We ultimately chose to use a number of neighboring slices equal to 2 and the wDice loss function to train our final model. To evaluate the model's performance, we trained three models using identical hyperparameters on three different data splits. The results showed that, on average, the model was able to detect 80% of all testing lesions, with a detection rate of 93% for lesions with maximum standardized uptake values (SUVmax) greater than 5.0. In addition, the average median lesion-wise DSC was 0.51 and 0.60 for all the lesions and lesions with SUVmax>5.0, respectively, on the testing set. Four additional neural networks with different architectures were trained, and they both yielded stronger performance of segmenting lesions whose SUVmax>5.0 compared to the rest of lesions.CONCLUSION: Our results demonstrate that prostate cancer metastases in PSMA PET/CT images can be detected and segmented using CNNs. The segmentation performance strongly depends on the intensity, size, and the location of lesions, and can be improved by using specialized loss functions. Specifically, the models performed best in detection of lesions with SUVmax>5.0. Another challenge was to accurately segment lesions close to the bladder. Future work will focus on improving the detection of lesions with lower SUV values by designing custom loss functions that take into account the lesion intensity, using additional data augmentation techniques, and reducing the number of false lesions by developing methods to better separate signal from noise.

Spinal Metastases Segmentation in MR Imaging using Deep Convolutional Neural Networks

Deep Learning-Based Automatic Segmentation for Size and Volumetric Measurement of Breast Cancer on Magnetic Resonance Imaging.

Automated Detection and Segmentation of Bone Metastases on Spine MRI Using U-Net: A Multicenter Study

Contrast-enhanced magnetic resonance image segmentation based on improved U-Net and Inception-ResNet in the diagnosis of spinal metastases

2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data

AI-Assisted Detection and Localization of Spinal Metastatic Lesions

The Dilated Dense U-net for Spinal Fracture Lesions Segmentation

Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

A Multi-Resolution Approach for Spinal Metastasis Detection Using Deep Siamese Neural Networks

Multiclass Spinal Cord Tumor Segmentation on MRI with Deep Learning

Automated Cervical Spinal Cord Segmentation in Real-World MRI of Multiple Sclerosis Patients by Optimized Hybrid Residual Attention-Aware Convolutional Neural Networks

Accurate Segmentation of Lumbar Spine Magnetic Resonance Imaging by Deep Neural Network with Size-Adaptive Loss.

Application of Deep Learning for Clinical Predictive Modeling: an Artificial Intelligence Recognition in Spinal Metastases.

Automated Classification of Intramedullary Spinal Cord Tumors and Inflammatory Demyelinating Lesions Using Deep Learning

Segmentation of Brain Metastases in MRI: A Two-Stage Deep Learning Approach with Modality Impact Study

Automated Segmentation of Multiple Sclerosis Lesions using Deep Learning

Automatic segmentation of the spinal cord and intramedullary multiple sclerosis lesions with convolutional neural networks

Automatic segmentation of prostate cancer metastases in PSMA PET/CT images using deep neural networks with weighted batch-wise dice loss

A NOVEL DEEP LEARNING METHOD FOR BRAIN TUMOR SEGMENTATION IN MAGNETIC RESONANCE IMAGES BASED ON RESIDUAL UNITS AND MODIFIED U-NET MODEL

Improved localization and segmentation of spinal bone metastases in MRI with nnUNet radiomics

DeepSeg: Deep Neural Network Framework for Automatic Brain Tumor Segmentation using Magnetic Resonance FLAIR Images