Abstract:Purpose: Brain metastases (BM) occur frequently in patients with metastatic cancer. Early and accurate detection of BM is essential for treatment planning and prognosis in radiation therapy. Due to their tiny sizes and relatively low contrast, small BM are very difficult to detect manually. With the recent development of deep learning technologies, several res earchers have reported promising results in automated brain metastasis detection. However, the detection sensitivity is still not high enough for tiny BM, and integration into clinical practice in regard to differentiating true metastases from false positives (FPs) is challenging. Methods: The DeepMedic network with the binary cross-entropy (BCE) loss is used as our baseline method. To improve brain metastasis detection performance, a custom detection loss called volume-level sensitivity-specificity (VSS) is proposed, which rates metastasis detection sensitivity and specificity at a (sub)volume level. As sensitivity and precision are always a trade-off, either a high sensitivity or a high precision can be achieved for brain metastasis detection by adjusting the weights in the VSS loss without decline in dice score coefficient for segmented metastases. To reduce metastasis-like structures being detected as FP metastases, a temporal prior volume is proposed as an additional input of DeepMedic. The modified network is called DeepMedic+ for distinction. Combining a high-sensitivity VSS loss and a high specificity loss for DeepMedic+, the majority of true positive metastases are confirmed with high specificity, while additional metastases candidates in each patient are marked with high sensitivity for detailed expert evaluation. Results: Our proposed VSS loss improves the sensitivity of brain metastasis detection, increasing the sensitivity from 85.3% for DeepMedic with BCE to 97.5% for DeepMedic with VSS. Alternatively, the precision is improved from 69.1% for DeepMedic with BCE to 98.7% for DeepMedic with VSS. Comparing DeepMedic+ with DeepMedic with the same VSS loss, 44.4% of the FP metastases are reduced in the high-sensitivity model and the precision reaches 99.6% for the high-specificity model. The mean dice coefficient for all metastases is about 0.81. With the ensemble of the high-sensitivity and high-specificity models, on average only 1.5 FP metastases per patient need further check, while the majority of true positive metastases are confirmed. Conclusions: Our proposed VSS loss and temporal prior improve brain metastasis detection sensitivity and precision. The ensemble learning is able to distinguish high confidence true positive metastases from metastases candidates that require special expert review or further follow-up, being particularly well-fit to the requirements of expert support in real clinical practice. This facilitates metastasis detection and segmentation for neuroradiologists in diagnostic and radiation oncologists in therapeutic clinical applications.

Development and Validation of a Deep-Learning Model for Detecting Brain Metastases on 3D Post-Contrast MRI: a Multi-Center Multi-Reader Evaluation Study.

Deep Learning-Based Detection and Segmentation-Assisted Management of Brain Metastases

Automatic Detection of Brain Metastases in T1-Weighted Construct-Enhanced MRI Using Deep Learning Model.

Automated segmentation of brain metastases with deep learning: A multi-center, randomized crossover, multi-reader evaluation study

MRI-based two-stage deep learning model for automatic detection and segmentation of brain metastases

Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

Deep Learning for Detecting Brain Metastases on MRI: A Systematic Review and Meta-Analysis

False-Negative and False-Positive Outcomes of an Artificial Intelligence System and Observers on Brain Metastasis Detection: Secondary Analysis of a Prospective, Multicentre, Multireader Study

False-negative and false-positive outcomes of computer-aided detection on brain metastasis: Secondary analysis of a multicenter, multireader study

Deep Learning With an Attention Mechanism for Differentiating the Origin of Brain Metastasis Using MR images

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases

Deep learning ensembles for detecting brain metastases in longitudinal multi-modal MRI studies

Development and Validation of a Deep Learning Model for Brain Tumor Diagnosis and Classification Using Magnetic Resonance Imaging

Deep Learning-Assisted Diagnosis of Liver Tumors Using Non-Contrast Magnetic Resonance Imaging: A Multi-Center Study

Evaluation of 'deep Learning System' (DLS) for Assistive Diagnosis of Brain Tumors Based on MR Image

2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data

Deep Learning for the Automatic Diagnosis and Analysis of Bone Metastasis on Bone Scintigrams

Deep Learning Detection and Segmentation of Brain Arteriovenous Malformation on Magnetic Resonance Angiography

A deep convolutional neural network-based automatic detection of brain metastases with and without blood vessel suppression

2.5D deep learning based on multi-parameter MRI to differentiate primary lung cancer pathological subtypes in patients with brain metastases