Abstract:Objective:To develop an approach for the automatic diagnosis of bone metastasis and to design a parameter of quantitative evaluation for tumor burden on bone scans based on deep learning technology.Methods:A total of 621 cases (389 males, 232 females, age: 12-93 years) of bone scan images from the Department of Nuclear Medicine in Tenth People′s Hospital of Tongji University from March 2018 to July 2019 were retrospectively analyzed. Images were divided into bone metastasis group and non-bone metastasis group. Eighty percent of the cases were randomly extracted from both groups as the training set, and the rest of cases were used as the test set. A deep residual convolutional neural network ResNet34 was used to construct the classification model and the segmentation model. The sensitivity, specificity and accuracy were calculated and the performance differences of the classification model in different age groups (15 cases of <50 years, 75 cases of ≥50 and <70 years, 33 cases of ≥70 years) were analyzed. The regions of metastatic bone lesions were automatically segmented by the segmentation model. The Dice coefficient was used to evaluate the effect of the segmentation model and the manual labeled results. Finally, the bone scans tumor burden index (BSTBI) was calculated to assess the tumor burden of bone metastases.Results:There were 280 cases with bone metastases and 341 cases with non-bone metastases, including 498 in training set and 123 in test set. The classification model could accurately identify bone metastases, with the sensitivity, specificity and accuracy of 92.59%(50/54), 85.51%(59/69) and 88.62%(109/123), respectively, and it performed best in the <50 years group (sensitivity, 2/2; specificity, 12/13; accuracy, 14/15). The specificity in the ≥70 years group (8/12) was the lowest. The Dice coefficient of bone metastatic area and bladder area were 0.739 and 0.925 in the segmentation model, which performed similarly in the three age groups. Preliminary results showed that the value of BSTBI increased with the increase of the number of bone metastatic lesions and the degree of 99Tc m-MDP uptake. The machine learning model in this study took (0.48±0.07) s for the entire analysis process from input to the final BSTBI calculation. Conclusions:The deep learning based on automatic diagnosis framework for bone metastases can automatically and accurately identify segment bone metastases and calculate tumor burden. It provides a new way for the interpretation of bone scans. The proposed BSTBI may be used as a quantitative evaluation indicator in the future to assess the tumor burden of bone metastases based on bone scans.

Multimodal Data-Driven Segmentation of Bone Metastasis Lesions in SPECT Bone Scans Using Deep Learning

Deep learning based automatic segmentation of metastasis hotspots in thorax bone SPECT images

Segmentation of lung cancer-caused metastatic lesions in bone scan images using self-defined model with deep supervision

Semi-supervised segmentation of metastasis lesions in bone scan images

Deep Learning for the Automatic Diagnosis and Analysis of Bone Metastasis on Bone Scintigrams

Automated Diagnosis of Bone Metastasis by Classifying Bone Scintigrams Using a Self-defined Deep Learning Model

Bone Metastases Lesion Segmentation on Breast Cancer Bone Scan Images with Negative Sample Training

Deep bone oncology Diagnostics: Computed tomography based Machine learning for detection of bone tumors from breast cancer metastasis

Automatic diagnosis and assessment of bone metastases on bone scans based on deep learning

Automated Diagnosis of Bone Metastasis Based on Multi-View Bone Scans Using Attention-Augmented Deep Neural Networks

BMSMM-Net: A Bone Metastasis Segmentation Framework Based on Mamba and Multiperspective Extraction

CT-Less Whole-Body Bone Segmentation of PET Images Using a Multimodal Deep Learning Network

Deep Learning-Based Image Segmentation on Multimodal Medical Imaging

Bone metastasis scintigram generation using generative adversarial learning with multi-receptive field learning and two-stage training

An end-to-end multi-task system of automatic lesion detection and anatomical localization in whole-body bone scintigraphy by deep learning

Deep learning-based detection and segmentation of osseous metastatic prostate cancer lesions on computed tomography

Bone metastasis segmentation based on Improved U-NET algorithm

Deep learning based identification of bone scintigraphies containing metastatic bone disease foci

An Intelligent Auxiliary Framework for Bone Malignant Tumor Lesion Segmentation in Medical Image Analysis

Automated Whole-Body Bone Lesion Detection for Multiple Myeloma on 68Ga-Pentixafor PET/CT Imaging Using Deep Learning Methods.

Segmentation of Brain Metastases in MRI: A Two-Stage Deep Learning Approach with Modality Impact Study