Abstract:Identification of the dominant intraprostatic lesion (DIL) using multiparametric-MRI (mp-MRI) can aid clinicians in the diagnosis, risk stratification, staging and therapeutic options in men with prostate cancer. Deep-learning based segmentation models such as Mask R-CNN are an emerging modality capable of identification and auto-segmentation of these lesions. However, model generation is limited by relatively sparse annotated data and anatomic challenges such as the ambiguous transition zone between the DIL and normal prostate tissue. Here we used a Mask R-CNN backbone in combination with semi-supervised training and image matting in an effort to overcome these limitations and achieve accurate segmentation of the DIL. A total of 244 patients, split into 2 cohorts, with biopsy proven prostate adenocarcinoma and mp-MRI imaging, were reviewed. Cohort 1 included 202 patients from the SPIE-AAPM-NCI Prostate MR Gleason Grade Group Challenge (PROSTATEx-2 Challenge). Cohort 2 included 42 patients from our institution. All patients in cohort 2 and 96 patients in cohort 1 had the DIL annotated by two experienced clinicians from our institution on T2-weighted imaging (T2WI) to establish the ground truth. Apparent diffusion coefficient mapping was rigidly registered to T2WI. A base Mask R-CNN model was trained in a supervised fashion using 84 annotated patients gathered from both cohorts. The base model with the most confident label was then used to predict 106 cohort 1 patients without annotations. The 84 annotated patients and 106 self-annotated patients were then used as the training set to train a semi-supervised model. Finally, image matting was applied as a post-processing approach to refine the boundaries of detected lesions. Ten annotated cohort 1 patients were used as the validation set and 23 and 21 cohort 1 and cohort 2 patients, respectively, were used as the testing set. Dice similarity coefficient (DSC) and the 95th percentile Hausdorff distance (95 HD) were used as evaluation metrics. We defined agreement as the degree to which a model's predictions concurred with the ground truth annotations. The DSC, 95HD (mm) and agreement for the validation on the base model were 0.659 ± 0.105, 3.75 ± 1.40, and 90.0%, respectively. For the testing set on the base model, these results were 0.564 ± 0.153, 4.52 ± 2.16 and 78.6%, respectively. When applying the semi-supervised model, the DSC, 95HD (mm) and agreement were 0.635 ± 0.142, 4.31 ± 1.34 and 100.0% for the validation set and 0.585 ± 0.146, 4.83 ± 2.53 and 76.8% on the testing set. Using image mapping, these values were increased to 0.725± 0.116, 3.70 ± 1.09, 100%; and 0.672 ± 0.123, 4.18 ± 1.97, 76.8% on validation and testing sets, respectively. Semi-supervised learning offered limited improvements when applied to the Mask R-CNN backbone model. However, image matting proved to be a powerful tool in improving the segmentation of the DIL.

Prostate and Tumor Segmentation on PET/CT Using Dual Mask R-CNN

Lung Tumor Segmentation of PET/CT Using Dual Pyramid Mask R-CNN

Segmentation of the Prostatic Gland and the Intraprostatic Lesions on Multiparametic MRI Using Mask-RCNN

Prostate cancer of magnetic resonance imaging automatic segmentation and detection of based on 3D-Mask RCNN

Prostate cancer detection and segmentation on MRI using non‐local mask R‐CNN with histopathological ground truth

Attention-guided multi-scale learning network for automatic prostate and tumor segmentation on MRI

A Learning-Based CT Prostate Segmentation Method Via Joint Transductive Feature Selection and Regression

Semi-Automatic Segmentation of Prostate in CT Images Via Coupled Feature Representation and Spatial-Constrained Transductive Lasso

Utilizing Semi-Supervised Learning and Image Matting in Combination with Mask R-CNN for Accurate Dominant Intraprostatic Lesion Identification and Segmentation on Multiparametric-MRI

A dual attention-guided 3D convolution network for automatic segmentation of prostate and tumor

Multi-organ Segmentation in Pelvic CT Images with CT-based Synthetic MRI

Tumor co-segmentation in PET/CT using multi-modality fully convolutional neural network

Segmentation of the prostate and organs at risk in male pelvic CT images using deep learning

A novel approach for automatic segmentation of prostate and its lesion regions on magnetic resonance imaging

Convolutional Neural Network Based Deep-Learning Architecture for Intraprostatic Tumour Contouring on PSMA PET Images in Patients with Primary Prostate Cancer.

Synthetic MRI-aided Pelvic Multi-Organ Segmentation in Cone-Beam Computed Tomography.

Intraprostatic Tumor Segmentation on PSMA PET Images in Patients with Primary Prostate Cancer with a Convolutional Neural Network.

A Novel PET Tumor Delineation Method Based on Adaptive Region-Growing and Dual-Front Active Contours

CT Male Pelvic Organ Segmentation Using Fully Convolutional Networks with Boundary Sensitive Representation

Automated Lung Cancer Segmentation Using a Dual-Modality Deep Learning Network with PET and CT Images

Prostate Segmentation in CT Images Via Spatial-Constrained Transductive Lasso