Diagnostic performance of deep learning models for detecting bone metastasis on whole-body bone scan in prostate cancer

Sangwon Han,Jungsu S. Oh,Jong Jin Lee

DOI: https://doi.org/10.1007/s00259-021-05481-2

2021-08-07

Abstract:We evaluated the performance of deep learning classifiers for bone scans of prostate cancer patients.

radiology, nuclear medicine & medical imaging

What problem does this paper attempt to address?

Automated Diagnosis of Bone Metastasis by Classifying Bone Scintigrams Using a Self-defined Deep Learning Model

Yubo Wang,Qiang Lin,Shaofang Zhao,Xianwu Zeng,Bowen Zheng,Yongchun Cao,Zhengxing Man

DOI: https://doi.org/10.2174/0115734056281578231212104108

2024-01-19

Current Medical Imaging Reviews

Abstract:Background:: Patients with cancer can develop bone metastasis when a solid tumor invades the bone, which is the third most commonly affected site by metastatic cancer, after the lung and liver. The early detection of bone metastases is crucial for making appropriate treatment decisions and increasing survival rates. Deep learning, a mainstream branch of machine learning, has rapidly become an effective approach to analyzing medical images. Objective:: To automatically diagnose bone metastasis with bone scintigraphy, in this work, we proposed to cast the bone metastasis diagnosis problem into automated image classification by developing a deep learning-based automated classification model. Methods:: A self-defined convolutional neural network consisting of a feature extraction sub-network and feature classification sub-network was proposed to automatically detect lung cancer bone metastasis, with a feature extraction sub-network extracting hierarchal features from SPECT bone scintigrams and feature classification sub-network classifying high-level features into two categories (i.e., images with metastasis and without metastasis). Results:: Using clinical data of SPECT bone scintigrams, the proposed model was evaluated to examine its detection accuracy. The best performance was achieved if the two images (i.e., anterior and posterior scans) acquired from each patient were fused using pixel-wise addition operation on the bladder-excluded images, obtaining the best scores of 0.8038, 0.8051, 0.8039, 0.8039, 0.8036, and 0.8489 for accuracy, precision, recall, specificity, F-1 score, and AUC value, respectively. Conclusion:: The proposed two-class classification network can predict whether an image contains lung cancer bone metastasis with the best performance as compared to existing classical deep learning models. The high accumulation of 99mTc MDP in the urinary bladder has a negative impact on automated diagnosis of bone metastasis. It is recommended to remove the urinary bladder before automated analysis.

radiology, nuclear medicine & medical imaging
Deep bone oncology Diagnostics: Computed tomography based Machine learning for detection of bone tumors from breast cancer metastasis

Xiao Zhao,Yue-han Dong,Li-yu Xu,Yan-yan Shen,Gang Qin,Zheng-bo Zhang

DOI: https://doi.org/10.1016/j.jbo.2024.100638

IF: 4.491

2024-09-28

Journal of Bone Oncology

Abstract:Purpose The objective of this study is to develop a novel diagnostic tool using deep learning and radiomics to distinguish bone tumors on CT images as metastases from breast cancer. By providing a more accurate and reliable method for identifying metastatic bone tumors, this approach aims to significantly improve clinical decision-making and patient management in the context of breast cancer. Methods This study utilized CT images of bone tumors from 178 patients, including 78 cases of breast cancer bone metastases and 100 cases of non-breast cancer bone metastases. The dataset was processed using the Medical Image Segmentation via Self-distilling TransUNet (MISSU) model for automated segmentation. Radiomics features were extracted from the segmented tumor regions using the Pyradiomics library, capturing various aspects of tumor phenotype. Feature selection was conducted using LASSO regression to identify the most predictive features. The model's performance was evaluated using ten-fold cross-validation, with metrics including accuracy, sensitivity, specificity, and the Dice similarity coefficient. Results The developed radiomics model using the SVM algorithm achieved high discriminatory power, with an AUC of 0.936 on the training set and 0.953 on the test set. The model's performance metrics demonstrated strong accuracy, sensitivity, and specificity. Specifically, the accuracy was 0.864 for the training set and 0.853 for the test set. Sensitivity values were 0.838 and 0.789 for the training and test sets, respectively, while specificity values were 0.896 and 0.933 for the training and test sets, respectively. These results indicate that the SVM model effectively distinguishes between bone metastases originating from breast cancer and other origins. Additionally, the average Dice similarity coefficient for the automated segmentation was 0.915, demonstrating a high level of agreement with manual segmentations. Conclusion This study demonstrates the potential of combining CT-based radiomics and deep learning for the accurate detection of bone metastases from breast cancer. The high-performance metrics indicate that this approach can significantly enhance diagnostic accuracy, aiding in early detection and improving patient outcomes. Future research should focus on validating these findings on larger datasets, integrating the model into clinical workflows, and exploring its use in personalized treatment planning.

oncology
Deep learning-based detection and segmentation of osseous metastatic prostate cancer lesions on computed tomography

S J Pawan,Joseph Matthew Rich,Shreyas Malewar,Daksh Patel,Matt Muellner,Darryl H Hwang,Xiaomeng Lei,Steven Y Cen,Timothy Triche,Amir Goldkorn,Passant Mohammed,Assad Oberai,Vinay Duddalwar

DOI: https://doi.org/10.1101/2024.11.01.24316594

2024-11-04

Abstract:Purpose: Prostate adenocarcinoma frequently metastasizes to bone and is detected via computed tomography (CT) scans. Accurate detection and segmentation of these lesions are critical for diagnosis, prognosis, and monitoring. This study aims to automate lesion detection and segmentation using deep learning models. Methods and Materials: We evaluated several deep learning models for lesion detection (EfficientNet, ResNet34, DenseNet) and segmentation (nnUNetv2, UNet, ResUNet, ResAttUNet). Performance metrics included F1 score, precision, recall, Area Under the Curve (AUC), and Dice Similarity Coefficient (DSC). Pairwise t-tests compared segmentation accuracy. Additionally, we conducted radiomic analyses to compare lesions segmented by deep learning to manual segmentations Results: EfficientNet achieved the highest detection performance, with an F1 score of 0.82, precision of 0.88, recall of 0.79, and AUC of 0.71. Among segmentation models, nnUNetv2 performed best, achieving a DSC of 0.74, with precision and recall values of 0.73 and 0.83, respectively. Pairwise t-tests showed that nnUNetv2 outperformed ResAttUNet, ResUNet, and UNet in segmentation accuracy (p < 0.01). Clinically, nnUNetv2 also demonstrated superior specificity for lesion detection (0.9) compared to the other models. All models performed similarly in distinguishing diffuse and focal lesions, predicting weight-bearing lesions, and identifying lesion locations, although nnUNetv2 had higher specificity for these tasks. Sensitivity was highest for rib lesions and lowest for spine lesions across all models. Conclusions: EfficientNet and nnUNetv2 were the top-performing models for detection and segmentation, respectively. The radiomic features derived from deep learning-based segmentations were comparable to those from manual segmentations, supporting the clinical applicability of these methods. Further analysis of lesion detection and spatial distribution, as well as lesion quality differentiation, underscores the models' potential for improving diagnostic workflows and patient outcomes in clinical settings.
Bone metastasis classification using whole body images from prostate cancer patients based on convolutional neural networks application

Nikolaos Papandrianos,Elpiniki Papageorgiou,Athanasios Anagnostis,Konstantinos Papageorgiou

DOI: https://doi.org/10.1371/journal.pone.0237213

IF: 3.7

2020-08-14

PLoS ONE

Abstract:Bone metastasis is one of the most frequent diseases in prostate cancer; scintigraphy imaging is particularly important for the clinical diagnosis of bone metastasis. Up to date, minimal research has been conducted regarding the application of machine learning with emphasis on modern efficient convolutional neural networks (CNNs) algorithms, for the diagnosis of prostate cancer metastasis from bone scintigraphy images. The advantageous and outstanding capabilities of deep learning, machine learning's groundbreaking technological advancement, have not yet been fully investigated regarding their application in computer-aided diagnosis systems in the field of medical image analysis, such as the problem of bone metastasis classification in whole-body scans. In particular, CNNs are gaining great attention due to their ability to recognize complex visual patterns, in the same way as human perception operates. Considering all these new enhancements in the field of deep learning, a set of simpler, faster and more accurate CNN architectures, designed for classification of metastatic prostate cancer in bones, is explored. This research study has a two-fold goal: to create and also demonstrate a set of simple but robust CNN models for automatic classification of whole-body scans in two categories, malignant (bone metastasis) or healthy, using solely the scans at the input level. Through a meticulous exploration of CNN hyper-parameter selection and fine-tuning, the best architecture is selected with respect to classification accuracy. Thus a CNN model with improved classification capabilities for bone metastasis diagnosis is produced, using bone scans from prostate cancer patients. The achieved classification testing accuracy is 97.38%, whereas the average sensitivity is approximately 95.8%. Finally, the best-performing CNN method is compared to other popular and well-known CNN architectures used for medical imaging, like VGG16, ResNet50, GoogleNet and MobileNet. The classification results show that the proposed CNN-based approach outperforms the popular CNN methods in nuclear medicine for metastatic prostate cancer diagnosis in bones.
Deep Learning-Based Detection and Classification of Bone Lesions on Staging Computed Tomography in Prostate Cancer: A Development Study

Mason J. Belue,Stephanie A. Harmon,Dong Yang,Julie Y. An,Sonia Gaur,Yan Mee Law,Evrim Turkbey,Ziyue Xu,Jesse Tetreault,Nathan S. Lay,Enis C. Yilmaz,Tim E. Phelps,Benjamin Simon,Liza Lindenberg,Esther Mena,Peter A. Pinto,Ulas Bagci,Bradford J. Wood,Deborah E. Citrin,William L. Dahut,Ravi A. Madan,James L. Gulley,Daguang Xu,Peter L. Choyke,Baris Turkbey

DOI: https://doi.org/10.1016/j.acra.2024.01.009

IF: 5.482

2024-01-24

Academic Radiology

Abstract:Rationale and Objectives Efficiently detecting and characterizing metastatic bone lesions on staging CT is crucial for prostate cancer (PCa) care. However, it demands significant expert time and additional imaging such as PET/CT. We aimed to develop an ensemble of two automated deep learning AI models for 1) bone lesion detection and segmentation and 2) benign vs. metastatic lesion classification on staging CTs and to compare its performance with radiologists. Materials and Methods This retrospective study developed two AI models using 297 staging CT scans (81 metastatic) with 4601 benign and 1911 metastatic lesions in PCa patients. Metastases were validated by follow-up scans, bone biopsy, or PET/CT. Segmentation AI (3DAISeg) was developed using the lesion contours delineated by a radiologist. 3DAISeg performance was evaluated with the Dice similarity coefficient, and classification AI (3DAIClass) performance on AI and radiologist contours was assessed with F1-score and accuracy. Training/validation/testing data partitions of 70:15:15 were used. A multi-reader study was performed with two junior and two senior radiologists within a subset of the testing dataset ( n = 36). Results In 45 unseen staging CT scans (12 metastatic PCa) with 669 benign and 364 metastatic lesions, 3DAISeg detected 73.1% of metastatic (266/364) and 72.4% of benign lesions (484/669). Each scan averaged 12 extra segmentations (range: 1–31). All metastatic scans had at least one detected metastatic lesion, achieving a 100% patient-level detection. The mean Dice score for 3DAISeg was 0.53 (median: 0.59, range: 0–0.87). The F1 for 3DAIClass was 94.8% (radiologist contours) and 92.4% (3DAISeg contours), with a median false positive of 0 (range: 0–3). Using radiologist contours, 3DAIClass had PPV and NPV rates comparable to junior and senior radiologists: PPV (semi-automated approach AI 40.0% vs. Juniors 32.0% vs. Seniors 50.0%) and NPV (AI 96.2% vs. Juniors 95.7% vs. Seniors 91.9%). When using 3DAISeg, 3DAIClass mimicked junior radiologists in PPV (pure-AI 20.0% vs. Juniors 32.0% vs. Seniors 50.0%) but surpassed seniors in NPV (pure-AI 93.8% vs. Juniors 95.7% vs. Seniors 91.9%). Conclusion Our lesion detection and classification AI model performs on par with junior and senior radiologists in discerning benign and metastatic lesions on staging CTs obtained for PCa.

radiology, nuclear medicine & medical imaging
A semi-automatic deep learning model based on biparametric MRI scanning strategy to predict bone metastases in newly diagnosed prostate cancer patients

Song Xinyang,Shen Tianci,Hu Xiangyu,Zhang Shuang,Wang Yangyang,Du Mengying,Xu Tonghui,Zhou Jingran,Yang Feng

DOI: https://doi.org/10.3389/fonc.2024.1298516

IF: 4.7

2024-06-12

Frontiers in Oncology

Abstract:Objective: To develop a semi-automatic model integrating radiomics, deep learning, and clinical features for Bone Metastasis (BM) prediction in prostate cancer (PCa) patients using Biparametric MRI (bpMRI) images. Methods: A retrospective study included 414 PCa patients (BM, n=136; NO-BM, n=278) from two institutions (Center 1, n=318; Center 2, n=96) between January 2016 and December 2022. MRI scans were confirmed with BM status via PET-CT or ECT pre-treatment. Tumor areas on bpMRI images were delineated as tumor's region of interest (ROI) using auto-delineation tumor models, evaluated with Dice similarity coefficient (DSC). Samples were auto-sketched, refined, and used to train the ResNet BM prediction model. Clinical, radiomics, and deep learning data were synthesized into the ResNet-C model, evaluated using receiver operating characteristic (ROC). Results: The auto-segmentation model achieved a DSC of 0.607. Clinical BM prediction's internal validation had an accuracy (ACC) of 0.650 and area under the curve (AUC) of 0.713; external cohort had an ACC of 0.668 and AUC of 0.757. The deep learning model yielded an ACC of 0.875 and AUC of 0.907 for the internal, and ACC of 0.833 and AUC of 0.862 for the external cohort. The Radiomics model registered an ACC of 0.819 and AUC of 0.852 internally, and ACC of 0.885 and AUC of 0.903 externally. ResNet-C demonstrated the highest ACC of 0.902 and AUC of 0.934 for the internal, and ACC of 0.885 and AUC of 0.903 for the external cohort. Conclusion: The ResNet-C model, utilizing bpMRI scanning strategy, accurately assesses bone metastasis (BM) status in newly diagnosed prostate cancer (PCa) patients, facilitating precise treatment planning and improving patient prognoses.

oncology
Bone Metastases Lesion Segmentation on Breast Cancer Bone Scan Images with Negative Sample Training

Yi-You Chen,Po-Nien Yu,Yung-Chi Lai,Te-Chun Hsieh,Da-Chuan Cheng

DOI: https://doi.org/10.3390/diagnostics13193042

2023-09-25

Abstract:The use of deep learning methods for the automatic detection and quantification of bone metastases in bone scan images holds significant clinical value. A fast and accurate automated system for segmenting bone metastatic lesions can assist clinical physicians in diagnosis. In this study, a small internal dataset comprising 100 breast cancer patients (90 cases of bone metastasis and 10 cases of non-metastasis) and 100 prostate cancer patients (50 cases of bone metastasis and 50 cases of non-metastasis) was used for model training. Initially, all image labels were binary. We used the Otsu thresholding method or negative mining to generate a non-metastasis mask, thereby transforming the image labels into three classes. We adopted the Double U-Net as the baseline model and made modifications to its output activation function. We changed the activation function to SoftMax to accommodate multi-class segmentation. Several methods were used to enhance model performance, including background pre-processing to remove background information, adding negative samples to improve model precision, and using transfer learning to leverage shared features between two datasets, which enhances the model's performance. The performance was investigated via 10-fold cross-validation and computed on a pixel-level scale. The best model we achieved had a precision of 69.96%, a sensitivity of 63.55%, and an F1-score of 66.60%. Compared to the baseline model, this represents an 8.40% improvement in precision, a 0.56% improvement in sensitivity, and a 4.33% improvement in the F1-score. The developed system has the potential to provide pre-diagnostic reports for physicians in final decisions and the calculation of the bone scan index (BSI) with the combination with bone skeleton segmentation.
Analysis of Bone Scans in Various Tumor Entities Using a Deep-Learning-Based Artificial Neural Network Algorithm—Evaluation of Diagnostic Performance

Jan Wuestemann,Sebastian Hupfeld,Dennis Kupitz,Philipp Genseke,Simone Schenke,Maciej Pech,Michael C. Kreissl,Oliver S. Grosser

DOI: https://doi.org/10.3390/cancers12092654

2020-09-17

Cancers

Abstract:The bone scan index (BSI), initially introduced for metastatic prostate cancer, quantifies the osseous tumor load from planar bone scans. Following the basic idea of radiomics, this method incorporates specific deep-learning techniques (artificial neural network) in its development to provide automatic calculation, feature extraction, and diagnostic support. As its performance in tumor entities, not including prostate cancer, remains unclear, our aim was to obtain more data about this aspect. The results of BSI evaluation of bone scans from 951 consecutive patients with different tumors were retrospectively compared to clinical reports (bone metastases, yes/no). Statistical analysis included entity-specific receiver operating characteristics to determine optimized BSI cut-off values. In addition to prostate cancer (cut-off = 0.27%, sensitivity (SN) = 87%, specificity (SP) = 99%), the algorithm used provided comparable results for breast cancer (cut-off 0.18%, SN = 83%, SP = 87%) and colorectal cancer (cut-off = 0.10%, SN = 100%, SP = 90%). Worse performance was observed for lung cancer (cut-off = 0.06%, SN = 63%, SP = 70%) and renal cell carcinoma (cut-off = 0.30%, SN = 75%, SP = 84%). The algorithm did not perform satisfactorily in melanoma (SN = 60%). For most entities, a high negative predictive value (NPV ≥ 87.5%, melanoma 80%) was determined, whereas positive predictive value (PPV) was clinically not applicable. Automatically determined BSI showed good sensitivity and specificity in prostate cancer and various other entities. Particularly, the high NPV encourages applying BSI as a tool for computer-aided diagnostic in various tumor entities.

oncology
AI diagnostics in bone oncology for predicting bone metastasis in lung cancer patients using DenseNet-264 deep learning model and radiomics

Taisheng Zeng,Yusi Chen,Daxin Zhu,Yifeng Huang,Ying Huang,Yijie Chen,Jianshe Shi,Bijiao Ding,Jianlong Huang

DOI: https://doi.org/10.1016/j.jbo.2024.100640

IF: 4.491

2024-09-27

Journal of Bone Oncology

Abstract:This study aims to predict bone metastasis in lung cancer patients using radiomics and deep learning. Early prediction of bone metastasis is crucial for timely intervention and personalized treatment plans. This can improve patient outcomes and quality of life. By integrating advanced imaging techniques with artificial intelligence, this study seeks to enhance predictive accuracy and clinical decision-making. Methods We included 189 lung cancer patients, comprising 89 with non-bone metastasis and 100 with confirmed bone metastasis. Radiomic features were extracted from CT images, and feature selection was performed using Minimum Redundancy Maximum Relevance (mRMR) and Least Absolute Shrinkage and Selection Operator (LASSO). We developed and validated a radiomics model and a deep learning model using DenseNet-264. Model performance was evaluated using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity. Statistical comparisons were made using the DeLong test. Results The radiomics model achieved an AUC of 0.815 on the training set and 0.778 on the validation set. The DenseNet-264 model demonstrated superior performance with an AUC of 0.990 on the training set and 0.971 on the validation set. The DeLong test confirmed that the AUC of the DenseNet-264 model was significantly higher than that of the radiomics model (p < 0.05). Conclusions The DenseNet-264 model significantly outperforms the radiomics model in predicting bone metastasis in lung cancer patients. The early and accurate prediction provided by the deep learning model can facilitate timely interventions and personalized treatment planning, potentially improving patient outcomes. Future studies should focus on validating these findings in larger, multi-center cohorts and integrating clinical data to further enhance predictive accuracy

oncology
Multimodal Data-Driven Segmentation of Bone Metastasis Lesions in SPECT Bone Scans Using Deep Learning

Xiaoqiang Ma,Qiang Lin,Sihan Guo,Yang He,Xianwu Zeng,Yaqiong Song,Yongchun Cao,Zhengxing Man,Caihong Liu,Xiaodi Huang

DOI: https://doi.org/10.2174/0115734056324977240911073841

Abstract:Background: Patients with malignant tumors often develop bone metastases. SPECT bone scintigraphy is an effective tool for surveying bone metastases due to its high sensitivity, low-cost equipment, and radiopharmaceutical. However, the low spatial resolution of SPECT scans significantly hinders manual analysis by nuclear medicine physicians. Deep learning, a promising technique for automated image analysis, can extract hierarchal patterns from images without human intervention. Objective: To enhance the performance of deep learning-based segmentation models, we integrate textual data from diagnostic reports with SPECT bone scans, aiming to develop an automated analysis method that outperforms purely unimodal data-driven segmentation models. Methods: We propose a dual-path segmentation framework to extract features from bone scan images and diagnostic reports separately. In the first path, an encoder-decoder network is employed to learn hierarchical representations of features from SPECT bone scan images. In the second path, the Chinese version of the MacBERT model is utilized to develop a text encoder for extracting features from diagnostic reports. The extracted textual features are then fused with image features during the decoding stage in the first path, enhancing the overall segmentation performance. Results: Experimental evaluation conducted on real-world clinical data demonstrated the superior performance of the proposed segmentation model. Our model achieved a 0.0209 increase in the DSC (Dice Similarity Coefficient) score compared to the well-known U-Net model. Conclusions: The proposed multimodal data-driven method effectively identifies and isolates metastasis lesions in SPECT bone scans, outperforming existing classical deep learning models. This study demonstrates the value of incorporating textual data in the deep learning-based segmentation of lowresolution SPECT bone scans.
A machine learning radiomics model based on bpMRI to predict bone metastasis in newly diagnosed prostate cancer patients.

Song Xinyang,Zhang Shuang,Shen Tianci,Hu Xiangyu,Wang Yangyang,Du Mengying,Zhou Jingran,Yang Feng

DOI: https://doi.org/10.1016/j.mri.2023.12.009

IF: 3.13

2024-01-04

Magnetic Resonance Imaging

Abstract:Objectives To develop and evaluate a machine learning radiomics model based on bpMRI to predict bone metastasis (BM) status in newly diagnosed prostate cancer (PCa) patients. Methods We retrospectively analyzed biparametric magnetic resonance imaging MRI (bpMRI) scans of PCa patients from multiple centers between January 2016 and October 2021. 348 PCa patients were recruited from two institutions for this study. The first institution contributed 284 patients, stratified and randomly divided into training and internal validation cohorts at a 7:3 ratio. The remaining 64 patients were sourced from the second institution and comprised the external validation cohort. Radiomics features were extracted from axial T2-weighted imaging (T2WI) and diffusion-weighted imaging (DWI) tumor regions. We developed the radiomics prediction model for BM in the training cohort and validated it in the internal and external validation cohorts. As a benchmark, we trained the logistic regression model with lasso feature reduction (LFR-LRM) in the training cohort and further compared it with Naive Bayes, eXtreme Gradient Boosting (XGboost), Random Forest (RF), GBDT, SVM, Adaboost, and KNN algorithms and validated in both the internal and external cohorts. The performance of several predictive models was assessed by receiver operating characteristic (ROC). Results The LFR-LRM model achieved an area under the receiver operating characteristic curve (AUC) of 0.89 (95% CI: 0.822–0.974) and an accuracy of 0.828 (95% CI: 0.713–0.911). The AUC and accuracy in external validation were 0.866 (95% CI: 0.784–0.948) and 0.769 (95% CI: 0.648–0.864), respectively. The RF and XGBoost models outperformed the LFR-LRM, with AUCs of 0.907 (95% CI: 0.863–0.949) and 0.928 (95% CI: 0.882–0.974) and accuracies of 0.831 (95% CI: 0.727–0.907) and 0.884 (95% CI: 0.792–0.946). External validation for these models yielded AUCs and accuracies of 0.911 (95% CI: 0.861–0.966), 0.921 (95% CI: 0.889–0.953), and 0.846 (95% CI: 0.735–0.923) and 0.876 (95% CI: 0.771–0.945), respectively. Conclusions The XGboost machine learning model is more accurate than LFR-LRM for predicting BM in patients with newly confirmed PCa.

radiology, nuclear medicine & medical imaging
Deep learning based identification of bone scintigraphies containing metastatic bone disease foci

Abdalla Ibrahim,Akshayaa Vaidyanathan,Sergey Primakov,Flore Belmans,Fabio Bottari,Turkey Refaee,Pierre Lovinfosse,Alexandre Jadoul,Celine Derwael,Fabian Hertel,Henry C Woodruff,Helle D Zacho,Sean Walsh,Wim Vos,Mariaelena Occhipinti,François-Xavier Hanin,Philippe Lambin,Felix M Mottaghy,Roland Hustinx

DOI: https://doi.org/10.1186/s40644-023-00524-3

IF: 5.605

2023-01-25

Cancer Imaging

Abstract:Purpose: Metastatic bone disease (MBD) is the most common form of metastases, most frequently deriving from prostate cancer. MBD is screened with bone scintigraphy (BS), which have high sensitivity but low specificity for the diagnosis of MBD, often requiring further investigations. Deep learning (DL) - a machine learning technique designed to mimic human neuronal interactions- has shown promise in the field of medical imaging analysis for different purposes, including segmentation and classification of lesions. In this study, we aim to develop a DL algorithm that can classify areas of increased uptake on bone scintigraphy scans. Methods: We collected 2365 BS from three European medical centres. The model was trained and validated on 1203 and 164 BS scans respectively. Furthermore we evaluated its performance on an external testing set composed of 998 BS scans. We further aimed to enhance the explainability of our developed algorithm, using activation maps. We compared the performance of our algorithm to that of 6 nuclear medicine physicians. Results: The developed DL based algorithm is able to detect MBD on BSs, with high specificity and sensitivity (0.80 and 0.82 respectively on the external test set), in a shorter time compared to the nuclear medicine physicians (2.5 min for AI and 30 min for nuclear medicine physicians to classify 134 BSs). Further prospective validation is required before the algorithm can be used in the clinic.
Detection and Segmentation of Pelvic Bones Metastases in MRI Images for Patients with Prostate Cancer Based on Deep Learning.

Xiang Liu,Chao Han,Yingpu Cui,Tingting Xie,Xiaodong Zhang,Xiaoying Wang

DOI: https://doi.org/10.3389/fonc.2021.773299

IF: 4.7

2021-01-01

Frontiers in Oncology

Abstract:OBJECTIVE:To establish and evaluate the 3D U-Net model for automated segmentation and detection of pelvic bone metastases in patients with prostate cancer (PCa) using diffusion-weighted imaging (DWI) and T1 weighted imaging (T1WI) images.METHODS:The model consisted of two 3D U-Net algorithms. A total of 859 patients with clinically suspected or confirmed PCa between January 2017 and December 2020 were enrolled for the first 3D U-Net development of pelvic bony structure segmentation. Then, 334 PCa patients were selected for the model development of bone metastases segmentation. Additionally, 63 patients from January to May 2021 were recruited for the external evaluation of the network. The network was developed using DWI and T1WI images as input. Dice similarity coefficient (DSC), volumetric similarity (VS), and Hausdorff distance (HD) were used to evaluate the segmentation performance. Sensitivity, specificity, and area under the curve (AUC) were used to evaluate the detection performance at the patient level; recall, precision, and F1-score were assessed at the lesion level.RESULTS:The pelvic bony structures segmentation on DWI and T1WI images had mean DSC and VS values above 0.85, and the HD values were <15 mm. In the testing set, the AUC of the metastases detection at the patient level were 0.85 and 0.80 on DWI and T1WI images. At the lesion level, the F1-score achieved 87.6% and 87.8% concerning metastases detection on DWI and T1WI images, respectively. In the external dataset, the AUC of the model for M-staging was 0.94 and 0.89 on DWI and T1WI images.CONCLUSION:The deep learning-based 3D U-Net network yields accurate detection and segmentation of pelvic bone metastases for PCa patients on DWI and T1WI images, which lays a foundation for the whole-body skeletal metastases assessment.
Auxiliary Diagnosis of Primary Bone Tumors Based on Machine Learning Model

Sandong Deng,Yugang Huang,Cong Li,Jun Qian,Xiangdong Wang

DOI: https://doi.org/10.1016/j.jbo.2024.100648

IF: 4.491

2024-01-01

Journal of Bone Oncology

Abstract:Objective Research on auxiliary diagnosis of primary bone tumors can enhance diagnostic accuracy, facilitate early detection, and enable personalized treatment, thereby reducing misdiagnosis and missed cases, ultimately leading to improved patient prognosis and survival rates. In this study, we established a whole slide imaging (WSI) database comprising histopathological samples from all categories of bone tumors and integrated multiple neural network architectures for machine learning models. We then evaluated the accuracy of these models in diagnosing primary bone tumors. Methods In this paper, the machine learning model based on the deep convolutional neural network (DC-NN) method was combined with imaging omics analysis to analyze and discuss its clinical value in diagnosing primary bone tumors. In addition, this paper proposed a screening method for differentially expressed genes. Based on the paired T-test method, the process first estimated the tumor purity in the experimental data of each sample case, then assessed the actual gene expression value of the experimental data of each sample case, and finally calculated the optimized paired T-test statistics, and screened differentially expressed genes according to the threshold value. Results The selected model demonstrated excellent diagnostic accuracy in distinguishing between normal and tumor images, with overall accuracy of (99.8 ± 0.4) % for five rounds of testing using the DCNN model and positive and negative predictive values of (100.0 ± 0.0) % and (99.6 ± 0.8) %, respectively. The mean area under each dataset’s curve (AUC) was (0.998 ± 0.004). Further, ten rounds of testing using the DCNN model showed an overall accuracy of (71.2 ± 1.6) % and a substantial positive predictive value of (91.9 ± 8.5) % in distinguishing benign from malignant bone tumors, with an average AUC of (0.62 ± 0.06) across datasets. Conclusion The deep learning model accurately classifies bone tumor histopathology based on the degree of infiltration, achieving diagnostic performance comparable to that of senior pathologists. These findings affirm the feasibility and effectiveness of histopathological diagnosis in bone tumors, providing a theoretical foundation for the application and advancement of machine learning-assisted histopathological diagnosis in this field.
Deep learning algorithm-based multimodal MRI radiomics and pathomics data improve prediction of bone metastases in primary prostate cancer

Yun-Feng Zhang,Chuan Zhou,Sheng Guo,Chao Wang,Jin Yang,Zhi-Jun Yang,Rong Wang,Xu Zhang,Feng-Hai Zhou

DOI: https://doi.org/10.1007/s00432-023-05574-5

2024-02-06

Journal of Cancer Research and Clinical Oncology

Abstract:Bone metastasis is a significant contributor to morbidity and mortality in advanced prostate cancer, and early diagnosis is challenging due to its insidious onset. The use of machine learning to obtain prognostic information from pathological images has been highlighted. However, there is a limited understanding of the potential of early prediction of bone metastasis through the feature combination method from various sources. This study presents a method of integrating multimodal data to enhance the feasibility of early diagnosis of bone metastasis in prostate cancer.

oncology
Deep learning model for the detection of prostate cancer and classification of clinically significant disease using multiparametric MRI in comparison to PI-RADs score

Chunguang Yang,Basen Li,Yang Luan,Shiwei Wang,Yang Bian,Junbiao Zhang,Zefeng Wang,Bo Liu,Xin Chen,Marcus Hacker,Zhen Li,Xiang Li,Zhihua Wang

DOI: https://doi.org/10.1016/j.urolonc.2024.01.021

IF: 2.954

2024-02-24

Urologic Oncology Seminars and Original Investigations

Abstract:Background The Prostate Imaging Reporting and Data System (PI-RADS) is an established reporting scheme for multiparametric magnetic resonance imaging (mpMRI) to distinguish clinically significant prostate cancer (csPCa). Deep learning (DL) holds great potential for automating csPCa classification on mpMRI. Method To compare the performance between a DL algorithm and PI-RADS categorization in PCa detection and csPCa classification, we included 1,729 consecutive patients who underwent radical prostatectomy or biopsy in Tongji hospital. We developed DL models by integrating individual mpMRI sequences and employing an ensemble approach for distinguishing between csPCa and CiSPCa (specifically defined as PCa with a Gleason group 1 or benign prostate disease, training cohort: 1,285 patients vs. external testing cohort: 315 patients). Results DL-based models exhibited higher csPCa detection rates than PI-RADS categorization (area under the curve [AUC]: 0.902; sensitivity: 0.728; specificity: 0.906 vs. AUC: 0.759; sensitivity: 0.761; specificity: 0.756) ( P < 0.001) Notably, DL networks exhibited significant strength in the prostate-specific antigen (PSA) arm < 10 ng/ml compared with PI-RADS assessment (AUC: 0.788; sensitivity: 0.588; specificity: 0.883 vs. AUC: 0.618; sensitivity: 0.379; specificity: 0.763) ( P = 0.041). Conclusions We developed DL-based mpMRI ensemble models for csPCa classification with improved sensitivity, specificity, and accuracy compared with clinical PI-RADS assessment. In the PSA-stratified condition, the DL ensemble model performed better than PI-RADS in the detection of csPCa in both the high PSA group and the low PSA group.

oncology,urology & nephrology
Automated Detection and Segmentation of Bone Metastases on Spine MRI Using U-Net: A Multicenter Study

Dong Hyun Kim,Jiwoon Seo,Ji Hyun Lee,Eun-Tae Jeon,DongYoung Jeong,Hee Dong Chae,Eugene Lee,Ji Hee Kang,Yoon-Hee Choi,Hyo Jin Kim,Jee Won Chai

DOI: https://doi.org/10.3348/kjr.2023.0671

IF: 7.109

2024-01-01

Korean Journal of Radiology

Abstract:OBJECTIVE: To develop and evaluate a deep learning model for automated segmentation and detection of bone metastasis on spinal MRI.MATERIALS AND METHODS: We included whole spine MRI scans of adult patients with bone metastasis: 662 MRI series from 302 patients (63.5 ± 11.5 years; male:female, 151:151) from three study centers obtained between January 2015 and August 2021 for training and internal testing (random split into 536 and 126 series, respectively) and 49 MRI series from 20 patients (65.9 ± 11.5 years; male:female, 11:9) from another center obtained between January 2018 and August 2020 for external testing. Three sagittal MRI sequences, including non-contrast T1-weighted image (T1), contrast-enhanced T1-weighted Dixon fat-only image (FO), and contrast-enhanced fat-suppressed T1-weighted image (CE), were used. Seven models trained using the 2D and 3D U-Nets were developed with different combinations (T1, FO, CE, T1 + FO, T1 + CE, FO + CE, and T1 + FO + CE). The segmentation performance was evaluated using Dice coefficient, pixel-wise recall, and pixel-wise precision. The detection performance was analyzed using per-lesion sensitivity and a free-response receiver operating characteristic curve. The performance of the model was compared with that of five radiologists using the external test set.RESULTS: The 2D U-Net T1 + CE model exhibited superior segmentation performance in the external test compared to the other models, with a Dice coefficient of 0.699 and pixel-wise recall of 0.653. The T1 + CE model achieved per-lesion sensitivities of 0.828 (497/600) and 0.857 (150/175) for metastases in the internal and external tests, respectively. The radiologists demonstrated a mean per-lesion sensitivity of 0.746 and a mean per-lesion positive predictive value of 0.701 in the external test.CONCLUSION: The deep learning models proposed for automated segmentation and detection of bone metastases on spinal MRI demonstrated high diagnostic performance.

radiology, nuclear medicine & medical imaging
Deep learning for differentiation of osteolytic osteosarcoma and giant cell tumor around the knee joint on radiographs: a multicenter study

Jingjing Shao,Hongxin Lin,Lei Ding,Bing Li,Danyang Xu,Yang Sun,Tianming Guan,Haiyang Dai,Ruihao Liu,Demao Deng,Bingsheng Huang,Shiting Feng,Xianfen Diao,Zhenhua Gao

DOI: https://doi.org/10.1186/s13244-024-01610-1

2024-02-07

Abstract:Objectives: To develop a deep learning (DL) model for differentiating between osteolytic osteosarcoma (OS) and giant cell tumor (GCT) on radiographs. Methods: Patients with osteolytic OS and GCT proven by postoperative pathology were retrospectively recruited from four centers (center A, training and internal testing; centers B, C, and D, external testing). Sixteen radiologists with different experiences in musculoskeletal imaging diagnosis were divided into three groups and participated with or without the DL model's assistance. DL model was generated using EfficientNet-B6 architecture, and the clinical model was trained using clinical variables. The performance of various models was compared using McNemar's test. Results: Three hundred thirty-three patients were included (mean age, 27 years ± 12 [SD]; 186 men). Compared to the clinical model, the DL model achieved a higher area under the curve (AUC) in both the internal (0.97 vs. 0.77, p = 0.008) and external test set (0.97 vs. 0.64, p < 0.001). In the total test set (including the internal and external test sets), the DL model achieved higher accuracy than the junior expert committee (93.1% vs. 72.4%; p < 0.001) and was comparable to the intermediate and senior expert committee (93.1% vs. 88.8%, p = 0.25; 87.1%, p = 0.35). With DL model assistance, the accuracy of the junior expert committee was improved from 72.4% to 91.4% (p = 0.051). Conclusion: The DL model accurately distinguished osteolytic OS and GCT with better performance than the junior radiologists, whose own diagnostic performances were significantly improved with the aid of the model, indicating the potential for the differential diagnosis of the two bone tumors on radiographs. Critical relevance statement: The deep learning model can accurately distinguish osteolytic osteosarcoma and giant cell tumor on radiographs, which may help radiologists improve the diagnostic accuracy of two types of tumors. Key points: • The DL model shows robust performance in distinguishing osteolytic osteosarcoma and giant cell tumor. • The diagnosis performance of the DL model is better than junior radiologists'. • The DL model shows potential for differentiating osteolytic osteosarcoma and giant cell tumor.
Deep Learning in Prostate Cancer Diagnosis Using Multiparametric Magnetic Resonance Imaging With Whole-Mount Histopathology Referenced Delineations

Danyan Li,Xiaowei Han,Jie Gao,Qing Zhang,Haibo Yang,Shu Liao,Hongqian Guo,Bing Zhang

DOI: https://doi.org/10.3389/fmed.2021.810995

IF: 3.9

2022-01-13

Frontiers in Medicine

Abstract:Background: Multiparametric magnetic resonance imaging (mpMRI) plays an important role in the diagnosis of prostate cancer (PCa) in the current clinical setting. However, the performance of mpMRI usually varies based on the experience of the radiologists at different levels; thus, the demand for MRI interpretation warrants further analysis. In this study, we developed a deep learning (DL) model to improve PCa diagnostic ability using mpMRI and whole-mount histopathology data. Methods: A total of 739 patients, including 466 with PCa and 273 without PCa, were enrolled from January 2017 to December 2019. The mpMRI (T2 weighted imaging, diffusion weighted imaging, and apparent diffusion coefficient sequences) data were randomly divided into training ( n = 659) and validation datasets ( n = 80). According to the whole-mount histopathology, a DL model, including independent segmentation and classification networks, was developed to extract the gland and PCa area for PCa diagnosis. The area under the curve (AUC) were used to evaluate the performance of the prostate classification networks. The proposed DL model was subsequently used in clinical practice (independent test dataset; n = 200), and the PCa detective/diagnostic performance between the DL model and different level radiologists was evaluated based on the sensitivity, specificity, precision, and accuracy. Results: The AUC of the prostate classification network was 0.871 in the validation dataset, and it reached 0.797 using the DL model in the test dataset. Furthermore, the sensitivity, specificity, precision, and accuracy of the DL model for diagnosing PCa in the test dataset were 0.710, 0.690, 0.696, and 0.700, respectively. For the junior radiologist without and with DL model assistance, these values were 0.590, 0.700, 0.663, and 0.645 versus 0.790, 0.720, 0.738, and 0.755, respectively. For the senior radiologist, the values were 0.690, 0.770, 0.750, and 0.730 vs. 0.810, 0.840, 0.835, and 0.825, respectively. The diagnosis made with DL model assistance for radiologists were significantly higher than those without assistance ( P < 0.05). Conclusion: The diagnostic performance of DL model is higher than that of junior radiologists and can improve PCa diagnostic accuracy in both junior and senior radiologists.

medicine, general & internal
Emerging Applications of Deep Learning in Bone Tumors: Current Advances and Challenges

Xiaowen Zhou,Hua Wang,Chengyao Feng,Ruilin Xu,Yu He,Lan Li,Chao Tu

DOI: https://doi.org/10.3389/fonc.2022.908873

IF: 4.7

2022-07-20

Frontiers in Oncology

Abstract:Deep learning is a subfield of state-of-the-art artificial intelligence (AI) technology, and multiple deep learning-based AI models have been applied to musculoskeletal diseases. Deep learning has shown the capability to assist clinical diagnosis and prognosis prediction in a spectrum of musculoskeletal disorders, including fracture detection, cartilage and spinal lesions identification, and osteoarthritis severity assessment. Meanwhile, deep learning has also been extensively explored in diverse tumors such as prostate, breast, and lung cancers. Recently, the application of deep learning emerges in bone tumors. A growing number of deep learning models have demonstrated good performance in detection, segmentation, classification, volume calculation, grading, and assessment of tumor necrosis rate in primary and metastatic bone tumors based on both radiological (such as X-ray, CT, MRI, SPECT) and pathological images, implicating a potential for diagnosis assistance and prognosis prediction of deep learning in bone tumors. In this review, we first summarized the workflows of deep learning methods in medical images and the current applications of deep learning-based AI for diagnosis and prognosis prediction in bone tumors. Moreover, the current challenges in the implementation of the deep learning method and future perspectives in this field were extensively discussed.

oncology

Diagnostic performance of deep learning models for detecting bone metastasis on whole-body bone scan in prostate cancer

Automated Diagnosis of Bone Metastasis by Classifying Bone Scintigrams Using a Self-defined Deep Learning Model

Deep bone oncology Diagnostics: Computed tomography based Machine learning for detection of bone tumors from breast cancer metastasis

Deep learning-based detection and segmentation of osseous metastatic prostate cancer lesions on computed tomography

Bone metastasis classification using whole body images from prostate cancer patients based on convolutional neural networks application

Deep Learning-Based Detection and Classification of Bone Lesions on Staging Computed Tomography in Prostate Cancer: A Development Study

A semi-automatic deep learning model based on biparametric MRI scanning strategy to predict bone metastases in newly diagnosed prostate cancer patients

Bone Metastases Lesion Segmentation on Breast Cancer Bone Scan Images with Negative Sample Training

Analysis of Bone Scans in Various Tumor Entities Using a Deep-Learning-Based Artificial Neural Network Algorithm—Evaluation of Diagnostic Performance

AI diagnostics in bone oncology for predicting bone metastasis in lung cancer patients using DenseNet-264 deep learning model and radiomics

Multimodal Data-Driven Segmentation of Bone Metastasis Lesions in SPECT Bone Scans Using Deep Learning

A machine learning radiomics model based on bpMRI to predict bone metastasis in newly diagnosed prostate cancer patients.

Deep learning based identification of bone scintigraphies containing metastatic bone disease foci

Detection and Segmentation of Pelvic Bones Metastases in MRI Images for Patients with Prostate Cancer Based on Deep Learning.

Auxiliary Diagnosis of Primary Bone Tumors Based on Machine Learning Model

Deep learning algorithm-based multimodal MRI radiomics and pathomics data improve prediction of bone metastases in primary prostate cancer

Deep learning model for the detection of prostate cancer and classification of clinically significant disease using multiparametric MRI in comparison to PI-RADs score

Automated Detection and Segmentation of Bone Metastases on Spine MRI Using U-Net: A Multicenter Study

Deep learning for differentiation of osteolytic osteosarcoma and giant cell tumor around the knee joint on radiographs: a multicenter study

Deep Learning in Prostate Cancer Diagnosis Using Multiparametric Magnetic Resonance Imaging With Whole-Mount Histopathology Referenced Delineations

Emerging Applications of Deep Learning in Bone Tumors: Current Advances and Challenges