Development of plastic disks containing flame retardants for elucidating changes in their concentrations due to simulated weathering and the application of these disks to weathering tests

N. Hanari,Takamitsu Otake,N. Itoh,Ayaka Wada,M. Ohata

DOI: https://doi.org/10.1007/s10661-017-5808-7

2017-01-31

Abstract:

What problem does this paper attempt to address?

Automated Diagnosis of Bone Metastasis by Classifying Bone Scintigrams Using a Self-defined Deep Learning Model

Yubo Wang,Qiang Lin,Shaofang Zhao,Xianwu Zeng,Bowen Zheng,Yongchun Cao,Zhengxing Man

DOI: https://doi.org/10.2174/0115734056281578231212104108

2024-01-19

Current Medical Imaging Reviews

Abstract:Background:: Patients with cancer can develop bone metastasis when a solid tumor invades the bone, which is the third most commonly affected site by metastatic cancer, after the lung and liver. The early detection of bone metastases is crucial for making appropriate treatment decisions and increasing survival rates. Deep learning, a mainstream branch of machine learning, has rapidly become an effective approach to analyzing medical images. Objective:: To automatically diagnose bone metastasis with bone scintigraphy, in this work, we proposed to cast the bone metastasis diagnosis problem into automated image classification by developing a deep learning-based automated classification model. Methods:: A self-defined convolutional neural network consisting of a feature extraction sub-network and feature classification sub-network was proposed to automatically detect lung cancer bone metastasis, with a feature extraction sub-network extracting hierarchal features from SPECT bone scintigrams and feature classification sub-network classifying high-level features into two categories (i.e., images with metastasis and without metastasis). Results:: Using clinical data of SPECT bone scintigrams, the proposed model was evaluated to examine its detection accuracy. The best performance was achieved if the two images (i.e., anterior and posterior scans) acquired from each patient were fused using pixel-wise addition operation on the bladder-excluded images, obtaining the best scores of 0.8038, 0.8051, 0.8039, 0.8039, 0.8036, and 0.8489 for accuracy, precision, recall, specificity, F-1 score, and AUC value, respectively. Conclusion:: The proposed two-class classification network can predict whether an image contains lung cancer bone metastasis with the best performance as compared to existing classical deep learning models. The high accumulation of 99mTc MDP in the urinary bladder has a negative impact on automated diagnosis of bone metastasis. It is recommended to remove the urinary bladder before automated analysis.

radiology, nuclear medicine & medical imaging
Multimodal Data-Driven Segmentation of Bone Metastasis Lesions in SPECT Bone Scans Using Deep Learning

Xiaoqiang Ma,Qiang Lin,Sihan Guo,Yang He,Xianwu Zeng,Yaqiong Song,Yongchun Cao,Zhengxing Man,Caihong Liu,Xiaodi Huang

DOI: https://doi.org/10.2174/0115734056324977240911073841

Abstract:Background: Patients with malignant tumors often develop bone metastases. SPECT bone scintigraphy is an effective tool for surveying bone metastases due to its high sensitivity, low-cost equipment, and radiopharmaceutical. However, the low spatial resolution of SPECT scans significantly hinders manual analysis by nuclear medicine physicians. Deep learning, a promising technique for automated image analysis, can extract hierarchal patterns from images without human intervention. Objective: To enhance the performance of deep learning-based segmentation models, we integrate textual data from diagnostic reports with SPECT bone scans, aiming to develop an automated analysis method that outperforms purely unimodal data-driven segmentation models. Methods: We propose a dual-path segmentation framework to extract features from bone scan images and diagnostic reports separately. In the first path, an encoder-decoder network is employed to learn hierarchical representations of features from SPECT bone scan images. In the second path, the Chinese version of the MacBERT model is utilized to develop a text encoder for extracting features from diagnostic reports. The extracted textual features are then fused with image features during the decoding stage in the first path, enhancing the overall segmentation performance. Results: Experimental evaluation conducted on real-world clinical data demonstrated the superior performance of the proposed segmentation model. Our model achieved a 0.0209 increase in the DSC (Dice Similarity Coefficient) score compared to the well-known U-Net model. Conclusions: The proposed multimodal data-driven method effectively identifies and isolates metastasis lesions in SPECT bone scans, outperforming existing classical deep learning models. This study demonstrates the value of incorporating textual data in the deep learning-based segmentation of lowresolution SPECT bone scans.
Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

Yixing Huang,Christoph Bert,Philipp Sommer,Benjamin Frey,Udo Gaipl,Luitpold V Distel,Thomas Weissmann,Michael Uder,Manuel A Schmidt,Arnd Dörfler,Andreas Maier,Rainer Fietkau,Florian Putz

DOI: https://doi.org/10.1002/mp.15863

Abstract:Purpose: Brain metastases (BM) occur frequently in patients with metastatic cancer. Early and accurate detection of BM is essential for treatment planning and prognosis in radiation therapy. Due to their tiny sizes and relatively low contrast, small BM are very difficult to detect manually. With the recent development of deep learning technologies, several res earchers have reported promising results in automated brain metastasis detection. However, the detection sensitivity is still not high enough for tiny BM, and integration into clinical practice in regard to differentiating true metastases from false positives (FPs) is challenging. Methods: The DeepMedic network with the binary cross-entropy (BCE) loss is used as our baseline method. To improve brain metastasis detection performance, a custom detection loss called volume-level sensitivity-specificity (VSS) is proposed, which rates metastasis detection sensitivity and specificity at a (sub)volume level. As sensitivity and precision are always a trade-off, either a high sensitivity or a high precision can be achieved for brain metastasis detection by adjusting the weights in the VSS loss without decline in dice score coefficient for segmented metastases. To reduce metastasis-like structures being detected as FP metastases, a temporal prior volume is proposed as an additional input of DeepMedic. The modified network is called DeepMedic+ for distinction. Combining a high-sensitivity VSS loss and a high specificity loss for DeepMedic+, the majority of true positive metastases are confirmed with high specificity, while additional metastases candidates in each patient are marked with high sensitivity for detailed expert evaluation. Results: Our proposed VSS loss improves the sensitivity of brain metastasis detection, increasing the sensitivity from 85.3% for DeepMedic with BCE to 97.5% for DeepMedic with VSS. Alternatively, the precision is improved from 69.1% for DeepMedic with BCE to 98.7% for DeepMedic with VSS. Comparing DeepMedic+ with DeepMedic with the same VSS loss, 44.4% of the FP metastases are reduced in the high-sensitivity model and the precision reaches 99.6% for the high-specificity model. The mean dice coefficient for all metastases is about 0.81. With the ensemble of the high-sensitivity and high-specificity models, on average only 1.5 FP metastases per patient need further check, while the majority of true positive metastases are confirmed. Conclusions: Our proposed VSS loss and temporal prior improve brain metastasis detection sensitivity and precision. The ensemble learning is able to distinguish high confidence true positive metastases from metastases candidates that require special expert review or further follow-up, being particularly well-fit to the requirements of expert support in real clinical practice. This facilitates metastasis detection and segmentation for neuroradiologists in diagnostic and radiation oncologists in therapeutic clinical applications.
Deep bone oncology Diagnostics: Computed tomography based Machine learning for detection of bone tumors from breast cancer metastasis

Xiao Zhao,Yue-han Dong,Li-yu Xu,Yan-yan Shen,Gang Qin,Zheng-bo Zhang

DOI: https://doi.org/10.1016/j.jbo.2024.100638

IF: 4.491

2024-09-28

Journal of Bone Oncology

Abstract:Purpose The objective of this study is to develop a novel diagnostic tool using deep learning and radiomics to distinguish bone tumors on CT images as metastases from breast cancer. By providing a more accurate and reliable method for identifying metastatic bone tumors, this approach aims to significantly improve clinical decision-making and patient management in the context of breast cancer. Methods This study utilized CT images of bone tumors from 178 patients, including 78 cases of breast cancer bone metastases and 100 cases of non-breast cancer bone metastases. The dataset was processed using the Medical Image Segmentation via Self-distilling TransUNet (MISSU) model for automated segmentation. Radiomics features were extracted from the segmented tumor regions using the Pyradiomics library, capturing various aspects of tumor phenotype. Feature selection was conducted using LASSO regression to identify the most predictive features. The model's performance was evaluated using ten-fold cross-validation, with metrics including accuracy, sensitivity, specificity, and the Dice similarity coefficient. Results The developed radiomics model using the SVM algorithm achieved high discriminatory power, with an AUC of 0.936 on the training set and 0.953 on the test set. The model's performance metrics demonstrated strong accuracy, sensitivity, and specificity. Specifically, the accuracy was 0.864 for the training set and 0.853 for the test set. Sensitivity values were 0.838 and 0.789 for the training and test sets, respectively, while specificity values were 0.896 and 0.933 for the training and test sets, respectively. These results indicate that the SVM model effectively distinguishes between bone metastases originating from breast cancer and other origins. Additionally, the average Dice similarity coefficient for the automated segmentation was 0.915, demonstrating a high level of agreement with manual segmentations. Conclusion This study demonstrates the potential of combining CT-based radiomics and deep learning for the accurate detection of bone metastases from breast cancer. The high-performance metrics indicate that this approach can significantly enhance diagnostic accuracy, aiding in early detection and improving patient outcomes. Future research should focus on validating these findings on larger datasets, integrating the model into clinical workflows, and exploring its use in personalized treatment planning.

oncology
Deep Learning for Identifying Metastatic Breast Cancer

Dayong Wang,Aditya Khosla,Rishab Gargeya,Humayun Irshad,Andrew H. Beck

DOI: https://doi.org/10.48550/arXiv.1606.05718

2016-06-18

Abstract:The International Symposium on Biomedical Imaging (ISBI) held a grand challenge to evaluate computational systems for the automated detection of metastatic breast cancer in whole slide images of sentinel lymph node biopsies. Our team won both competitions in the grand challenge, obtaining an area under the receiver operating curve (AUC) of 0.925 for the task of whole slide image classification and a score of 0.7051 for the tumor localization task. A pathologist independently reviewed the same images, obtaining a whole slide image classification AUC of 0.966 and a tumor localization score of 0.733. Combining our deep learning system's predictions with the human pathologist's diagnoses increased the pathologist's AUC to 0.995, representing an approximately 85 percent reduction in human error rate. These results demonstrate the power of using deep learning to produce significant improvements in the accuracy of pathological diagnoses.

Quantitative Methods,Computer Vision and Pattern Recognition
Deep Learning-Based Detection and Classification of Bone Lesions on Staging Computed Tomography in Prostate Cancer: A Development Study

Mason J. Belue,Stephanie A. Harmon,Dong Yang,Julie Y. An,Sonia Gaur,Yan Mee Law,Evrim Turkbey,Ziyue Xu,Jesse Tetreault,Nathan S. Lay,Enis C. Yilmaz,Tim E. Phelps,Benjamin Simon,Liza Lindenberg,Esther Mena,Peter A. Pinto,Ulas Bagci,Bradford J. Wood,Deborah E. Citrin,William L. Dahut,Ravi A. Madan,James L. Gulley,Daguang Xu,Peter L. Choyke,Baris Turkbey

DOI: https://doi.org/10.1016/j.acra.2024.01.009

IF: 5.482

2024-01-24

Academic Radiology

Abstract:Rationale and Objectives Efficiently detecting and characterizing metastatic bone lesions on staging CT is crucial for prostate cancer (PCa) care. However, it demands significant expert time and additional imaging such as PET/CT. We aimed to develop an ensemble of two automated deep learning AI models for 1) bone lesion detection and segmentation and 2) benign vs. metastatic lesion classification on staging CTs and to compare its performance with radiologists. Materials and Methods This retrospective study developed two AI models using 297 staging CT scans (81 metastatic) with 4601 benign and 1911 metastatic lesions in PCa patients. Metastases were validated by follow-up scans, bone biopsy, or PET/CT. Segmentation AI (3DAISeg) was developed using the lesion contours delineated by a radiologist. 3DAISeg performance was evaluated with the Dice similarity coefficient, and classification AI (3DAIClass) performance on AI and radiologist contours was assessed with F1-score and accuracy. Training/validation/testing data partitions of 70:15:15 were used. A multi-reader study was performed with two junior and two senior radiologists within a subset of the testing dataset ( n = 36). Results In 45 unseen staging CT scans (12 metastatic PCa) with 669 benign and 364 metastatic lesions, 3DAISeg detected 73.1% of metastatic (266/364) and 72.4% of benign lesions (484/669). Each scan averaged 12 extra segmentations (range: 1–31). All metastatic scans had at least one detected metastatic lesion, achieving a 100% patient-level detection. The mean Dice score for 3DAISeg was 0.53 (median: 0.59, range: 0–0.87). The F1 for 3DAIClass was 94.8% (radiologist contours) and 92.4% (3DAISeg contours), with a median false positive of 0 (range: 0–3). Using radiologist contours, 3DAIClass had PPV and NPV rates comparable to junior and senior radiologists: PPV (semi-automated approach AI 40.0% vs. Juniors 32.0% vs. Seniors 50.0%) and NPV (AI 96.2% vs. Juniors 95.7% vs. Seniors 91.9%). When using 3DAISeg, 3DAIClass mimicked junior radiologists in PPV (pure-AI 20.0% vs. Juniors 32.0% vs. Seniors 50.0%) but surpassed seniors in NPV (pure-AI 93.8% vs. Juniors 95.7% vs. Seniors 91.9%). Conclusion Our lesion detection and classification AI model performs on par with junior and senior radiologists in discerning benign and metastatic lesions on staging CTs obtained for PCa.

radiology, nuclear medicine & medical imaging
Optimized deep learning networks for accurate identification of cancer cells in bone marrow

Venkatachalam Kandasamy,Vladimir Simic,Nebojsa Bacanin,Dragan Pamucar

DOI: https://doi.org/10.1016/j.neunet.2024.106822

IF: 7.8

2024-10-30

Neural Networks

Abstract:Radiologists utilize pictures from X-rays, magnetic resonance imaging, or computed tomography scans to diagnose bone cancer. Manual methods are labor-intensive and may need specialized knowledge. As a result, creating an automated process for distinguishing between malignant and healthy bone is essential. Bones that have cancer have a different texture than bones in unaffected areas. Diagnosing hematological illnesses relies on correct labeling and categorizing nucleated cells in the bone marrow. However, timely diagnosis and treatment are hampered by pathologists' need to identify specimens, which can be sensitive and time-consuming manually. Humanity's ability to evaluate and identify these more complicated illnesses has significantly been bolstered by the development of artificial intelligence, particularly machine, and deep learning. Conversely, much research and development is needed to enhance cancer cell identification—and lower false alarm rates. We built a deep learning model for morphological analysis to solve this problem. This paper introduces a novel deep convolutional neural network architecture in which hybrid multi-objective and category-based optimization algorithms are used to optimize the hyperparameters adaptively. Using the processed cell pictures as input, the proposed model is then trained with an optimized attention-based multi-scale convolutional neural network to identify the kind of cancer cells in the bone marrow. Extensive experiments are run on publicly available datasets, with the results being measured and evaluated using a wide range of performance indicators. In contrast to deep learning models that have already been trained, the total accuracy of 99.7% was determined to be superior.

computer science, artificial intelligence,neurosciences
Analysis of Bone Scans in Various Tumor Entities Using a Deep-Learning-Based Artificial Neural Network Algorithm—Evaluation of Diagnostic Performance

Jan Wuestemann,Sebastian Hupfeld,Dennis Kupitz,Philipp Genseke,Simone Schenke,Maciej Pech,Michael C. Kreissl,Oliver S. Grosser

DOI: https://doi.org/10.3390/cancers12092654

2020-09-17

Cancers

Abstract:The bone scan index (BSI), initially introduced for metastatic prostate cancer, quantifies the osseous tumor load from planar bone scans. Following the basic idea of radiomics, this method incorporates specific deep-learning techniques (artificial neural network) in its development to provide automatic calculation, feature extraction, and diagnostic support. As its performance in tumor entities, not including prostate cancer, remains unclear, our aim was to obtain more data about this aspect. The results of BSI evaluation of bone scans from 951 consecutive patients with different tumors were retrospectively compared to clinical reports (bone metastases, yes/no). Statistical analysis included entity-specific receiver operating characteristics to determine optimized BSI cut-off values. In addition to prostate cancer (cut-off = 0.27%, sensitivity (SN) = 87%, specificity (SP) = 99%), the algorithm used provided comparable results for breast cancer (cut-off 0.18%, SN = 83%, SP = 87%) and colorectal cancer (cut-off = 0.10%, SN = 100%, SP = 90%). Worse performance was observed for lung cancer (cut-off = 0.06%, SN = 63%, SP = 70%) and renal cell carcinoma (cut-off = 0.30%, SN = 75%, SP = 84%). The algorithm did not perform satisfactorily in melanoma (SN = 60%). For most entities, a high negative predictive value (NPV ≥ 87.5%, melanoma 80%) was determined, whereas positive predictive value (PPV) was clinically not applicable. Automatically determined BSI showed good sensitivity and specificity in prostate cancer and various other entities. Particularly, the high NPV encourages applying BSI as a tool for computer-aided diagnostic in various tumor entities.

oncology
Bone scintigraphy based on deep learning model and modified growth optimizer

Omnia Magdy,Mohamed Abd Elaziz,Abdelghani Dahou,Ahmed A. Ewees,Ahmed Elgarayhi,Mohammed Sallah

DOI: https://doi.org/10.1038/s41598-024-73991-8

IF: 4.6

2024-10-30

Scientific Reports

Abstract:Bone scintigraphy is recognized as an efficient diagnostic method for whole-body screening for bone metastases. At the moment, whole-body bone scan image analysis is primarily dependent on manual reading by nuclear medicine doctors. However, manual analysis needs substantial experience and is both stressful and time-consuming. To address the aforementioned issues, this work proposed a machine-learning technique that uses phases to detect Bone scintigraphy. The first phase in the proposed model is the feature extraction and it was conducted based on integrating the Mobile Vision Transformer (MobileViT) model in our framework to capture highly complex representations from raw medical imagery using two primary components including ViT and lightweight CNN featuring a limited number of parameters. In addition, the second phase is named feature selection, and it is dependent on the Arithmetic Optimization Algorithm (AOA) being used to improve the Growth Optimizer (GO). We evaluate the performance of the proposed FS model, named GOAOA using a set of 18 UCI datasets. Additionally, the applicability of Bone scintigraphy for real-world application is evaluated using 2800 bone scan images (1400 normal and 1400 abnormal). The results and statistical analysis revealed that the proposed GOAOA algorithm as an FS technique outperforms the other FS algorithms employed in this study.

multidisciplinary sciences
Subcutaneous fat predicts bone metastasis in breast cancer: A novel multimodality-based deep learning model

Shidi Miao,Haobo Jia,Wenjuan Huang,Ke Cheng,Wenjin Zhou,Ruitao Wang

DOI: https://doi.org/10.3233/CBM-230219

Abstract:Objectives: This study explores a deep learning (DL) approach to predicting bone metastases in breast cancer (BC) patients using clinical information, such as the fat index, and features like Computed Tomography (CT) images. Methods: CT imaging data and clinical information were collected from 431 BC patients who underwent radical surgical resection at Harbin Medical University Cancer Hospital. The area of muscle and adipose tissue was obtained from CT images at the level of the eleventh thoracic vertebra. The corresponding histograms of oriented gradients (HOG) and local binary pattern (LBP) features were extracted from the CT images, and the network features were derived from the LBP and HOG features as well as the CT images through deep learning (DL). The combination of network features with clinical information was utilized to predict bone metastases in BC patients using the Gradient Boosting Decision Tree (GBDT) algorithm. Regularized Cox regression models were employed to identify independent prognostic factors for bone metastasis. Results: The combination of clinical information and network features extracted from LBP features, HOG features, and CT images using a convolutional neural network (CNN) yielded the best performance, achieving an AUC of 0.922 (95% confidence interval [CI]: 0.843-0.964, P< 0.01). Regularized Cox regression results indicated that the subcutaneous fat index was an independent prognostic factor for bone metastasis in breast cancer (BC). Conclusion: Subcutaneous fat index could predict bone metastasis in BC patients. Deep learning multimodal algorithm demonstrates superior performance in assessing bone metastases in BC patients.
Deep learning assessment compared to radiologist reporting for metastatic spinal cord compression on CT

James Thomas Patrick Decourcy Hallinan,Lei Zhu,Wenqiao Zhang,Shuliang Ge,Faimee Erwan Muhamat Nor,Han Yang Ong,Sterling Ellis Eide,Amanda J. L. Cheng,Tricia Kuah,Desmond Shi Wei Lim,Xi Zhen Low,Kuan Yuen Yeong,Mona I. AlMuhaish,Nesaretnam Barr Kumarakulasinghe,Ee Chin Teo,Qai Ven Yap,Yiong Huak Chan,Shuxun Lin,Jiong Hao Tan,Naresh Kumar,Balamurugan A. Vellayappan,Beng Chin Ooi,Swee Tian Quek,Andrew Makmur,Ahmed Mohamed Alsooreti

DOI: https://doi.org/10.3389/fonc.2023.1151073

IF: 4.7

2023-05-05

Frontiers in Oncology

Abstract:Introduction: Metastatic spinal cord compression (MSCC) is a disastrous complication of advanced malignancy. A deep learning (DL) algorithm for MSCC classification on CT could expedite timely diagnosis. In this study, we externally test a DL algorithm for MSCC classification on CT and compare with radiologist assessment. Methods: Retrospective collection of CT and corresponding MRI from patients with suspected MSCC was conducted from September 2007 to September 2020. Exclusion criteria were scans with instrumentation, no intravenous contrast, motion artefacts and non-thoracic coverage. Internal CT dataset split was 84% for training/validation and 16% for testing. An external test set was also utilised. Internal training/validation sets were labelled by radiologists with spine imaging specialization (6 and 11-years post-board certification) and were used to further develop a DL algorithm for MSCC classification. The spine imaging specialist (11-years expertise) labelled the test sets (reference standard). For evaluation of DL algorithm performance, internal and external test data were independently reviewed by four radiologists: two spine specialists (Rad1 and Rad2, 7 and 5-years post-board certification, respectively) and two oncological imaging specialists (Rad3 and Rad4, 3 and 5-years post-board certification, respectively). DL model performance was also compared against the CT report issued by the radiologist in a real clinical setting. Inter-rater agreement (Gwet's kappa) and sensitivity/specificity/AUCs were calculated. Results: Overall, 420 CT scans were evaluated (225 patients, mean age=60 ± 11.9[SD]); 354(84%) CTs for training/validation and 66(16%) CTs for internal testing. The DL algorithm showed high inter-rater agreement for three-class MSCC grading with kappas of 0.872 (p<0.001) and 0.844 (p<0.001) on internal and external testing, respectively. On internal testing DL algorithm inter-rater agreement (κ=0.872) was superior to Rad 2 (κ=0.795) and Rad 3 (κ=0.724) (both p<0.001). DL algorithm kappa of 0.844 on external testing was superior to Rad 3 (κ=0.721) (p<0.001). CT report classification of high-grade MSCC disease was poor with only slight inter-rater agreement (κ=0.027) and low sensitivity (44.0), relative to the DL algorithm with almost-perfect inter-rater agreement (κ=0.813) and high sensitivity (94.0) (p<0.001). Conclusion: Deep learning algorithm for metastatic spinal cord compression on CT showed superior performance to the CT report issued by experienced radiologists and could aid earlier diagnosis.

oncology
Deep learning based automatic segmentation of metastasis hotspots in thorax bone SPECT images

Qiang Lin,Mingyang Luo,Ruiting Gao,Tongtong Li,Zhengxing Man,Yongchun Cao,Haijun Wang

DOI: https://doi.org/10.1371/journal.pone.0243253

IF: 3.7

2020-12-03

PLoS ONE

Abstract:SPECT imaging has been identified as an effective medical modality for diagnosis, treatment, evaluation and prevention of a range of serious diseases and medical conditions. Bone SPECT scan has the potential to provide more accurate assessment of disease stage and severity. Segmenting hotspot in bone SPECT images plays a crucial role to calculate metrics like tumor uptake and metabolic tumor burden. Deep learning techniques especially the convolutional neural networks have been widely exploited for reliable segmentation of hotspots or lesions, organs and tissues in the traditional structural medical images (i.e., CT and MRI) due to their ability of automatically learning the features from images in an optimal way. In order to segment hotspots in bone SPECT images for automatic assessment of metastasis, in this work, we develop several deep learning based segmentation models. Specifically, each original whole-body bone SPECT image is processed to extract the thorax area, followed by image mirror, translation and rotation operations, which augments the original dataset. We then build segmentation models based on two commonly-used famous deep networks including U-Net and Mask R-CNN by fine-tuning their structures. Experimental evaluation conducted on a group of real-world bone SEPCT images reveals that the built segmentation models are workable on identifying and segmenting hotspots of metastasis in bone SEPCT images, achieving a value of 0.9920, 0.7721, 0.6788 and 0.6103 for PA (accuracy), CPA (precision), Rec (recall) and IoU , respectively. Finally, we conclude that the deep learning technology have the huge potential to identify and segment hotspots in bone SPECT images.

multidisciplinary sciences
Bone Metastases Lesion Segmentation on Breast Cancer Bone Scan Images with Negative Sample Training

Yi-You Chen,Po-Nien Yu,Yung-Chi Lai,Te-Chun Hsieh,Da-Chuan Cheng

DOI: https://doi.org/10.3390/diagnostics13193042

2023-09-25

Abstract:The use of deep learning methods for the automatic detection and quantification of bone metastases in bone scan images holds significant clinical value. A fast and accurate automated system for segmenting bone metastatic lesions can assist clinical physicians in diagnosis. In this study, a small internal dataset comprising 100 breast cancer patients (90 cases of bone metastasis and 10 cases of non-metastasis) and 100 prostate cancer patients (50 cases of bone metastasis and 50 cases of non-metastasis) was used for model training. Initially, all image labels were binary. We used the Otsu thresholding method or negative mining to generate a non-metastasis mask, thereby transforming the image labels into three classes. We adopted the Double U-Net as the baseline model and made modifications to its output activation function. We changed the activation function to SoftMax to accommodate multi-class segmentation. Several methods were used to enhance model performance, including background pre-processing to remove background information, adding negative samples to improve model precision, and using transfer learning to leverage shared features between two datasets, which enhances the model's performance. The performance was investigated via 10-fold cross-validation and computed on a pixel-level scale. The best model we achieved had a precision of 69.96%, a sensitivity of 63.55%, and an F1-score of 66.60%. Compared to the baseline model, this represents an 8.40% improvement in precision, a 0.56% improvement in sensitivity, and a 4.33% improvement in the F1-score. The developed system has the potential to provide pre-diagnostic reports for physicians in final decisions and the calculation of the bone scan index (BSI) with the combination with bone skeleton segmentation.
Deep learning-based detection and segmentation of osseous metastatic prostate cancer lesions on computed tomography

S J Pawan,Joseph Matthew Rich,Shreyas Malewar,Daksh Patel,Matt Muellner,Darryl H Hwang,Xiaomeng Lei,Steven Y Cen,Timothy Triche,Amir Goldkorn,Passant Mohammed,Assad Oberai,Vinay Duddalwar

DOI: https://doi.org/10.1101/2024.11.01.24316594

2024-11-04

Abstract:Purpose: Prostate adenocarcinoma frequently metastasizes to bone and is detected via computed tomography (CT) scans. Accurate detection and segmentation of these lesions are critical for diagnosis, prognosis, and monitoring. This study aims to automate lesion detection and segmentation using deep learning models. Methods and Materials: We evaluated several deep learning models for lesion detection (EfficientNet, ResNet34, DenseNet) and segmentation (nnUNetv2, UNet, ResUNet, ResAttUNet). Performance metrics included F1 score, precision, recall, Area Under the Curve (AUC), and Dice Similarity Coefficient (DSC). Pairwise t-tests compared segmentation accuracy. Additionally, we conducted radiomic analyses to compare lesions segmented by deep learning to manual segmentations Results: EfficientNet achieved the highest detection performance, with an F1 score of 0.82, precision of 0.88, recall of 0.79, and AUC of 0.71. Among segmentation models, nnUNetv2 performed best, achieving a DSC of 0.74, with precision and recall values of 0.73 and 0.83, respectively. Pairwise t-tests showed that nnUNetv2 outperformed ResAttUNet, ResUNet, and UNet in segmentation accuracy (p < 0.01). Clinically, nnUNetv2 also demonstrated superior specificity for lesion detection (0.9) compared to the other models. All models performed similarly in distinguishing diffuse and focal lesions, predicting weight-bearing lesions, and identifying lesion locations, although nnUNetv2 had higher specificity for these tasks. Sensitivity was highest for rib lesions and lowest for spine lesions across all models. Conclusions: EfficientNet and nnUNetv2 were the top-performing models for detection and segmentation, respectively. The radiomic features derived from deep learning-based segmentations were comparable to those from manual segmentations, supporting the clinical applicability of these methods. Further analysis of lesion detection and spatial distribution, as well as lesion quality differentiation, underscores the models' potential for improving diagnostic workflows and patient outcomes in clinical settings.
An end-to-end multi-task system of automatic lesion detection and anatomical localization in whole-body bone scintigraphy by deep learning

Kaibin Huang,Shengyun Huang,Guojing Chen,Xue Li,Shawn Li,Ying Liang,Yi Gao

DOI: https://doi.org/10.1093/bioinformatics/btac753

IF: 5.8

2022-11-23

Bioinformatics

Abstract:Abstract Summary Limited by spatial resolution and visual contrast, bone scintigraphy interpretation is susceptible to subjective factors, which considerably affects the accuracy and repeatability of lesion detection and anatomical localization. In this work, we design and implement an end-to-end multi-task deep learning model to perform automatic lesion detection and anatomical localization in whole-body bone scintigraphy. A total of 617 whole-body bone scintigraphy cases including anterior and posterior views were retrospectively analyzed. The proposed semi-supervised model consists of two task flows. The first one, the lesion segmentation flow, received image patches and was trained in a supervised way. The other one, skeleton segmentation flow, was trained on as few as five labeled images in conjunction with the multi-atlas approach, in a semi-supervised way. The two flows joint in their encoder layers so each flow can capture more generalized distribution of the sample space and extract more abstract deep features. The experimental results show that the architecture achieved the highest precision in the finest bone segmentation task in both anterior and posterior images of whole-body scintigraphy. Such an end-to-end approach with very few manual annotation requirement would be suitable for algorithm deployment. Moreover, the proposed approach reliably balances unsupervised labels construction and supervised learning, providing useful insight for weakly labeled image analysis. Supplementary information Supplementary data are available at Bioinformatics online.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Bone metastasis scintigram generation using generative adversarial learning with multi-receptive field learning and two-stage training

Qiang Lin,An Xie,Xianwu Zeng,Yongchun Cao,Zhengxing Man,Yusheng Hao,Caihong Liu,Xiaodi Huang

DOI: https://doi.org/10.1002/mp.17368

2024-09-03

Abstract:Background: Deep learning is the primary method for conducting automated analysis of SPECT bone scintigrams. The lack of available large-scale data significantly hinders the development of well-performing deep learning models, as the performance of a deep learning model is positively correlated with the size of the dataset used. Therefore, there is an urgent demand for an automated data generation method to enlarge the dataset of SPECT bone scintigrams. Purpose: We introduce a deep learning-based generation model that can generate realistic but not identical samples from the original SPECT bone scintigrams. Methods: Following the generative adversarial learning architecture, a bone metastasis scintigram generation model christened BMS-Gen is proposed. First, BMS-Gen takes multiple input conditions and employs multi-receptive field learning to ensure that the generated samples are as realistic as possible. Second, BMS-Gen adopts generative adversarial learning to retain the diversity of the generated samples. Last, BMS-Gen uses a two-stage training strategy to improve the quality of the generated samples. Results: Experimental evaluation conducted on a set of clinical data of SPECT BM scintigrams has shown the performance of the proposed BMS-Gen, achieving the best overall scores of 1678.0, 69.33, and 19.51 for FID (Fréchet Inception Distance), MSE (Mean Square Error), and PSNR (Peak Signal-to-Noise Ratio) metrics. The introduction of samples generated by BMS-Gen contributes a maximum (minimum) increase of 3.01% (0.15%) on the F-1 score and a maximum (minimum) increase of 6.83% (2.21%) on the DSC score for the image classification and segmentation tasks, respectively. Conclusions: The proposed BMS-Gen model can be used as a promising tool for augmenting the data of bone scintigrams, greatly facilitating the development of deep learning-based automated analysis of SPECT bone scintigrams.
A deep learning algorithm for detecting lytic bone lesions of multiple myeloma on CT

Shahriar Faghani,Francis I Baffour,Michael D Ringler,Matthew Hamilton-Cave,Pouria Rouzrokh,Mana Moassefi,Bardia Khosravi,Bradley J Erickson

DOI: https://doi.org/10.1007/s00256-022-04160-z

Abstract:Background: Whole-body low-dose CT is the recommended initial imaging modality to evaluate bone destruction as a result of multiple myeloma. Accurate interpretation of these scans to detect small lytic bone lesions is time intensive. A functional deep learning) algorithm to detect lytic lesions on CTs could improve the value of these CTs for myeloma imaging. Our objectives were to develop a DL algorithm and determine its performance at detecting lytic lesions of multiple myeloma. Methods: Axial slices (2-mm section thickness) from whole-body low-dose CT scans of subjects with biochemically confirmed plasma cell dyscrasias were included in the study. Data were split into train and test sets at the patient level targeting a 90%/10% split. Two musculoskeletal radiologists annotated lytic lesions on the images with bounding boxes. Subsequently, we developed a two-step deep learning model comprising bone segmentation followed by lesion detection. Unet and "You Look Only Once" (YOLO) models were used as bone segmentation and lesion detection algorithms, respectively. Diagnostic performance was determined using the area under the receiver operating characteristic curve (AUROC). Results: Forty whole-body low-dose CTs from 40 subjects yielded 2193 image slices. A total of 5640 lytic lesions were annotated. The two-step model achieved a sensitivity of 91.6% and a specificity of 84.6%. Lesion detection AUROC was 90.4%. Conclusion: We developed a deep learning model that detects lytic bone lesions of multiple myeloma on whole-body low-dose CTs with high performance. External validation is required prior to widespread adoption in clinical practice.
Deep Learning With an Attention Mechanism for Differentiating the Origin of Brain Metastasis Using MR images

Tianyu Jiao,Fuyan Li,Yi Cui,Xiao Wang,Butuo Li,Feng Shi,Yuwei Xia,Qing Zhou,Qingshi Zeng

DOI: https://doi.org/10.1002/jmri.28695

IF: 4.4

2023-03-27

Journal of Magnetic Resonance Imaging

Abstract:Background Brain metastasis (BM) is a serious neurological complication of cancer of different origins. The value of deep learning (DL) to identify multiple types of primary origins remains unclear. Purpose To distinguish primary site of BM and identify the best DL models. Study Type Retrospective. Population A total of 449 BM derived from 214 patients (49.5% for female, mean age 58 years) (100 from small cell lung cancer [SCLC], 125 from non‐small cell lung cancer [NSCLC], 116 from breast cancer [BC], and 108 from gastrointestinal cancer [GIC]) were included. Field Strength/Sequence A 3‐T, T1 turbo spin echo (T1‐TSE), T2‐TSE, T2FLAIR‐TSE, DWI echo‐planar imaging (DWI‐EPI) and contrast‐enhanced T1‐TSE (CE T1‐TSE). Assessment Lesions were divided into training (n = 285, 153 patients), testing (n = 122, 93 patients), and independent testing cohorts (n = 42, 34 patients). Three‐dimensional residual network (3D‐ResNet), named 3D ResNet6 and 3D ResNet 18, was proposed for identifying the four origins based on single MRI and combined MRI (T1WI + T2‐FLAIR + DWI, CE‐T1WI + DWI, CE‐T1WI + T2WI + DWI). DL model was used to distinguish lung cancer from non‐lung cancer; then SCLC vs. NSCLC for lung cancer classification and BC vs. GIC for non‐lung cancer classification was performed. A subjective visual analysis was implemented and compared with DL models. Gradient‐weighted class activation mapping (Grad‐CAM) was used to visualize the model by heatmaps. Statistical Tests The area under the receiver operating characteristics curve (AUC) assess each classification performance. Results 3D ResNet18 with Grad‐CAM and AIC showed better performance than 3DResNet6, 3DResNet18 and the radiologist for distinguishing lung cancer from non‐lung cancer, SCLC from NSCLC, and BC from GIC. For single MRI sequence, T1WI, DWI, and CE‐T1WI performed best for lung cancer vs. non‐lung cancer, SCLC vs. NSCLC, and BC vs. GIC classifications. The AUC ranged from 0.675 to 0.876 and from 0.684 to 0.800 regarding the testing and independent testing datasets, respectively. For combined MRI sequences, the combination of CE‐T1WI + T2WI + DWI performed better for BC vs. GIC (AUCs of 0.788 and 0.848 on testing and independent testing datasets, respectively), while the combined MRI approach (T1WI + T2‐FLAIR + DWI, CE‐T1WI + DWI) could not achieve higher AUCs for lung cancer vs. non‐lung cancer, SCLC vs. NSCLC. Grad‐CAM helped for model visualization by heatmaps that focused on tumor regions. Data Conclusion DL models may help to distinguish the origins of BM based on MRI data. Evidence Level 3 Technical Efficacy Stage 2.

radiology, nuclear medicine & medical imaging
Yellow rain — a palynological analysis

J. W. Nowicke,M. Meselson

DOI: https://doi.org/10.1038/309205A0

IF: 64.8

1984-05-17

Nature

Abstract:
Advancing Musculoskeletal Tumor Diagnosis: Automated Segmentation and Predictive Classification using Deep Learning and Radiomics

Shuo Wang,Man Sun,Jinglai Sun,Qingsong Wang,Guangpu Wang,Xiaolin Wang,Xianghong Meng,Zhi Wang,Hui Yu

DOI: https://doi.org/10.1016/j.compbiomed.2024.108502

IF: 7.7

2024-04-24

Computers in Biology and Medicine

Abstract:Objectives Musculoskeletal (MSK) tumors, given their high mortality rate and heterogeneity, necessitate precise examination and diagnosis to guide clinical treatment effectively. Magnetic resonance imaging (MRI) is pivotal in detecting MSK tumors, as it offers exceptional image contrast between bone and soft tissue. This study aims to enhance the speed of detection and the diagnostic accuracy of MSK tumors through automated segmentation and grading utilizing MRI. Materials and methods The research included 170 patients (mean age, 58 years ± 12 (standard deviation), 84 men) with MSK lesions, who underwent MRI scans from April 2021 to May 2023. We proposed a deep learning (DL) segmentation model MSAPN based on multi-scale attention and pixel-level reconstruction, and compared it with existing algorithms. Using MSAPN-segmented lesions to extract their radiomic features for the benign and malignant classification of tumors. Results Compared to the most advanced segmentation algorithms, MSAPN demonstrates better performance. The Dice similarity coefficients (DSC) are 0.871 and 0.815 in the testing set and independent validation set, respectively. The radiomics model for classifying benign and malignant lesions achieves an accuracy of 0.890. Moreover, there is no statistically significant difference between the radiomics model based on manual segmentation and MSAPN segmentation. Conclusion This research contributes to the advancement of MSK tumor diagnosis through automated segmentation and predictive classification. The integration of DL algorithms and radiomics shows promising results, and the visualization analysis of feature maps enhances clinical interpretability.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology

Development of plastic disks containing flame retardants for elucidating changes in their concentrations due to simulated weathering and the application of these disks to weathering tests

Automated Diagnosis of Bone Metastasis by Classifying Bone Scintigrams Using a Self-defined Deep Learning Model

Multimodal Data-Driven Segmentation of Bone Metastasis Lesions in SPECT Bone Scans Using Deep Learning

Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

Deep bone oncology Diagnostics: Computed tomography based Machine learning for detection of bone tumors from breast cancer metastasis

Deep Learning for Identifying Metastatic Breast Cancer

Deep Learning-Based Detection and Classification of Bone Lesions on Staging Computed Tomography in Prostate Cancer: A Development Study

Optimized deep learning networks for accurate identification of cancer cells in bone marrow

Analysis of Bone Scans in Various Tumor Entities Using a Deep-Learning-Based Artificial Neural Network Algorithm—Evaluation of Diagnostic Performance

Bone scintigraphy based on deep learning model and modified growth optimizer

Subcutaneous fat predicts bone metastasis in breast cancer: A novel multimodality-based deep learning model

Deep learning assessment compared to radiologist reporting for metastatic spinal cord compression on CT

Deep learning based automatic segmentation of metastasis hotspots in thorax bone SPECT images

Bone Metastases Lesion Segmentation on Breast Cancer Bone Scan Images with Negative Sample Training

Deep learning-based detection and segmentation of osseous metastatic prostate cancer lesions on computed tomography

An end-to-end multi-task system of automatic lesion detection and anatomical localization in whole-body bone scintigraphy by deep learning

Bone metastasis scintigram generation using generative adversarial learning with multi-receptive field learning and two-stage training

A deep learning algorithm for detecting lytic bone lesions of multiple myeloma on CT

Deep Learning With an Attention Mechanism for Differentiating the Origin of Brain Metastasis Using MR images

Yellow rain — a palynological analysis

Advancing Musculoskeletal Tumor Diagnosis: Automated Segmentation and Predictive Classification using Deep Learning and Radiomics