Abstract:Purpose: Brain metastases (BM) occur frequently in patients with metastatic cancer. Early and accurate detection of BM is essential for treatment planning and prognosis in radiation therapy. Due to their tiny sizes and relatively low contrast, small BM are very difficult to detect manually. With the recent development of deep learning technologies, several res earchers have reported promising results in automated brain metastasis detection. However, the detection sensitivity is still not high enough for tiny BM, and integration into clinical practice in regard to differentiating true metastases from false positives (FPs) is challenging. Methods: The DeepMedic network with the binary cross-entropy (BCE) loss is used as our baseline method. To improve brain metastasis detection performance, a custom detection loss called volume-level sensitivity-specificity (VSS) is proposed, which rates metastasis detection sensitivity and specificity at a (sub)volume level. As sensitivity and precision are always a trade-off, either a high sensitivity or a high precision can be achieved for brain metastasis detection by adjusting the weights in the VSS loss without decline in dice score coefficient for segmented metastases. To reduce metastasis-like structures being detected as FP metastases, a temporal prior volume is proposed as an additional input of DeepMedic. The modified network is called DeepMedic+ for distinction. Combining a high-sensitivity VSS loss and a high specificity loss for DeepMedic+, the majority of true positive metastases are confirmed with high specificity, while additional metastases candidates in each patient are marked with high sensitivity for detailed expert evaluation. Results: Our proposed VSS loss improves the sensitivity of brain metastasis detection, increasing the sensitivity from 85.3% for DeepMedic with BCE to 97.5% for DeepMedic with VSS. Alternatively, the precision is improved from 69.1% for DeepMedic with BCE to 98.7% for DeepMedic with VSS. Comparing DeepMedic+ with DeepMedic with the same VSS loss, 44.4% of the FP metastases are reduced in the high-sensitivity model and the precision reaches 99.6% for the high-specificity model. The mean dice coefficient for all metastases is about 0.81. With the ensemble of the high-sensitivity and high-specificity models, on average only 1.5 FP metastases per patient need further check, while the majority of true positive metastases are confirmed. Conclusions: Our proposed VSS loss and temporal prior improve brain metastasis detection sensitivity and precision. The ensemble learning is able to distinguish high confidence true positive metastases from metastases candidates that require special expert review or further follow-up, being particularly well-fit to the requirements of expert support in real clinical practice. This facilitates metastasis detection and segmentation for neuroradiologists in diagnostic and radiation oncologists in therapeutic clinical applications.

Enhancing brain metastasis prediction in non-small cell lung cancer: a deep learning-based segmentation and CT radiomics-based ensemble learning model

Multimodal radiomics-based methods using deep learning for prediction of brain metastasis in non-small cell lung cancer with 18F-FDG PET/CT images

Brain metastasis magnetic resonance imaging-based deep learning for predicting epidermal growth factor receptor (EGFR) mutation and subtypes in metastatic non-small cell lung cancer

Dose-Incorporated Deep Ensemble Learning for Improving Brain Metastasis SRS Outcome Prediction

Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features

Fully convolutional neural network-based segmentation of brain metastases: a comprehensive approach for accurate detection and localization

Deep-learning and radiomics ensemble classifier for false positive reduction in brain metastases segmentation

Predicting bone metastasis-free survival in non-small cell lung cancer from preoperative CT via deep learning

Deep learning of bone metastasis in small cell lung cancer: A large sample-based study

Machine-Learning-Aided Prediction of Brain Metastases Development in Non-Small-Cell Lung Cancers

Predicting benefit from immune checkpoint inhibitors in patients with non-small-cell lung cancer by CT-based ensemble deep learning: a retrospective study

Deep Learning to Predict EGFR Mutation and PD-L1 Expression Status in Non-Small-Cell Lung Cancer on Computed Tomography Images

Multimodal Data-Driven Segmentation of Bone Metastasis Lesions in SPECT Bone Scans Using Deep Learning

A Radiomics Model Developed from Pre-Metastatic Brain Magnetic Resonance Imaging to Predict Brain Metastasis in Non–small-Cell Lung Cancer: Evidence to the Seed-and-soil Theory.

A multi-task deep learning model for EGFR genotyping prediction and GTV segmentation of brain metastasis

Potential of radiomics analysis and machine learning for predicting brain metastasis in newly diagnosed lung cancer patients

Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

Deep bone oncology Diagnostics: Computed tomography based Machine learning for detection of bone tumors from breast cancer metastasis

Deep Learning-Based Detection and Segmentation-Assisted Management of Brain Metastases

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning

Longitudinal deep neural networks for assessing metastatic brain cancer on a large open benchmark