[A case of diffuse peritonitis with hemolytic hepato-renal syndrome after abortion].

S. Pavlović,M. Velickovic,A. Pedovic

1960-10-01

Srpski arhiv za celokupno lekarstvo

Abstract:

What problem does this paper attempt to address?

Deep learning ensembles for detecting brain metastases in longitudinal multi-modal MRI studies

Bartosz Machura,Damian Kucharski,Oskar Bozek,Bartosz Eksner,Bartosz Kokoszka,Tomasz Pekala,Mateusz Radom,Marek Strzelczak,Lukasz Zarudzki,Benjamín Gutiérrez-Becker,Agata Krason,Jean Tessier,Jakub Nalepa

DOI: https://doi.org/10.1016/j.compmedimag.2024.102401

IF: 7.422

2024-05-24

Computerized Medical Imaging and Graphics

Abstract:Metastatic brain cancer is a condition characterized by the migration of cancer cells to the brain from extracranial sites. Notably, metastatic brain tumors surpass primary brain tumors in prevalence by a significant factor, they exhibit an aggressive growth potential and have the capacity to spread across diverse cerebral locations simultaneously. Magnetic resonance imaging (MRI) scans of individuals afflicted with metastatic brain tumors unveil a wide spectrum of characteristics. These lesions vary in size and quantity, spanning from tiny nodules to substantial masses captured within MRI. Patients may present with a limited number of lesions or an extensive burden of hundreds of them. Moreover, longitudinal studies may depict surgical resection cavities, as well as areas of necrosis or edema. Thus, the manual analysis of such MRI scans is difficult, user-dependent and cost-inefficient, and—importantly—it lacks reproducibility. We address these challenges and propose a pipeline for detecting and analyzing brain metastases in longitudinal studies, which benefits from an ensemble of various deep learning architectures originally designed for different downstream tasks (detection and segmentation). The experiments, performed over 275 multi-modal MRI scans of 87 patients acquired in 53 sites, coupled with rigorously validated manual annotations, revealed that our pipeline, built upon open-source tools to ensure its reproducibility, offers high-quality detection, and allows for precisely tracking the disease progression. To objectively quantify the generalizability of models, we introduce a new data stratification approach that accommodates the heterogeneity of the dataset and is used to elaborate training-test splits in a data-robust manner, alongside a new set of quality metrics to objectively assess algorithms. Our system provides a fully automatic and quantitative approach that may support physicians in a laborious process of disease progression tracking and evaluation of treatment efficacy.

engineering, biomedical,radiology, nuclear medicine & medical imaging
Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

Yixing Huang,Christoph Bert,Philipp Sommer,Benjamin Frey,Udo Gaipl,Luitpold V Distel,Thomas Weissmann,Michael Uder,Manuel A Schmidt,Arnd Dörfler,Andreas Maier,Rainer Fietkau,Florian Putz

DOI: https://doi.org/10.1002/mp.15863

Abstract:Purpose: Brain metastases (BM) occur frequently in patients with metastatic cancer. Early and accurate detection of BM is essential for treatment planning and prognosis in radiation therapy. Due to their tiny sizes and relatively low contrast, small BM are very difficult to detect manually. With the recent development of deep learning technologies, several res earchers have reported promising results in automated brain metastasis detection. However, the detection sensitivity is still not high enough for tiny BM, and integration into clinical practice in regard to differentiating true metastases from false positives (FPs) is challenging. Methods: The DeepMedic network with the binary cross-entropy (BCE) loss is used as our baseline method. To improve brain metastasis detection performance, a custom detection loss called volume-level sensitivity-specificity (VSS) is proposed, which rates metastasis detection sensitivity and specificity at a (sub)volume level. As sensitivity and precision are always a trade-off, either a high sensitivity or a high precision can be achieved for brain metastasis detection by adjusting the weights in the VSS loss without decline in dice score coefficient for segmented metastases. To reduce metastasis-like structures being detected as FP metastases, a temporal prior volume is proposed as an additional input of DeepMedic. The modified network is called DeepMedic+ for distinction. Combining a high-sensitivity VSS loss and a high specificity loss for DeepMedic+, the majority of true positive metastases are confirmed with high specificity, while additional metastases candidates in each patient are marked with high sensitivity for detailed expert evaluation. Results: Our proposed VSS loss improves the sensitivity of brain metastasis detection, increasing the sensitivity from 85.3% for DeepMedic with BCE to 97.5% for DeepMedic with VSS. Alternatively, the precision is improved from 69.1% for DeepMedic with BCE to 98.7% for DeepMedic with VSS. Comparing DeepMedic+ with DeepMedic with the same VSS loss, 44.4% of the FP metastases are reduced in the high-sensitivity model and the precision reaches 99.6% for the high-specificity model. The mean dice coefficient for all metastases is about 0.81. With the ensemble of the high-sensitivity and high-specificity models, on average only 1.5 FP metastases per patient need further check, while the majority of true positive metastases are confirmed. Conclusions: Our proposed VSS loss and temporal prior improve brain metastasis detection sensitivity and precision. The ensemble learning is able to distinguish high confidence true positive metastases from metastases candidates that require special expert review or further follow-up, being particularly well-fit to the requirements of expert support in real clinical practice. This facilitates metastasis detection and segmentation for neuroradiologists in diagnostic and radiation oncologists in therapeutic clinical applications.
2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data

Jon André Ottesen,Darvin Yi,Elizabeth Tong,Michael Iv,Anna Latysheva,Cathrine Saxhaug,Kari Dolven Jacobsen,Åslaug Helland,Kyrre Eeg Emblem,Daniel L. Rubin,Atle Bjørnerud,Greg Zaharchuk,Endre Grøvik

DOI: https://doi.org/10.3389/fninf.2022.1056068

2023-01-18

Frontiers in Neuroinformatics

Abstract:Introduction: Management of patients with brain metastases is often based on manual lesion detection and segmentation by an expert reader. This is a time- and labor-intensive process, and to that end, this work proposes an end-to-end deep learning segmentation network for a varying number of available MRI available sequences. Methods: We adapt and evaluate a 2.5D and a 3D convolution neural network trained and tested on a retrospective multinational study from two independent centers, in addition, nnU-Net was adapted as a comparative benchmark. Segmentation and detection performance was evaluated by: (1) the dice similarity coefficient, (2) a per-metastases and the average detection sensitivity, and (3) the number of false positives. Results: The 2.5D and 3D models achieved similar results, albeit the 2.5D model had better detection rate, whereas the 3D model had fewer false positive predictions, and nnU-Net had fewest false positives, but with the lowest detection rate. On MRI data from center 1, the 2.5D, 3D, and nnU-Net detected 79%, 71%, and 65% of all metastases; had an average per patient sensitivity of 0.88, 0.84, and 0.76; and had on average 6.2, 3.2, and 1.7 false positive predictions per patient, respectively. For center 2, the 2.5D, 3D, and nnU-Net detected 88%, 86%, and 78% of all metastases; had an average per patient sensitivity of 0.92, 0.91, and 0.85; and had on average 1.0, 0.4, and 0.1 false positive predictions per patient, respectively. Discussion/Conclusion: Our results show that deep learning can yield highly accurate segmentations of brain metastases with few false positives in multinational data, but the accuracy degrades for metastases with an area smaller than 0.4 cm 2 .

neurosciences,mathematical & computational biology
Deep Learning Based Multi-Organ Segmentation And Metastases Segmentation In Whole Mouse Body And The Cryo-Imaging Cancer Imaging And Therapy Analysis Platform (Citap)

Yiqiao Liu,Madhu Gargesha,Mohammed Q. Qutaish,Zhuxian Zhou,Bryan Scott,Hamed Yousefi,Zheng-Rong Lu,David L. Wilson

DOI: https://doi.org/10.1117/12.2549801

2021-01-01

Abstract:We are creating a cancer imaging and therapy analysis platform (CITAP), featuring image analysis/visualization software and multi-spectral cryo-imaging to support innovations in preclinical cancer research. Cryo-imaging repeatedly sections and tiles microscope images of the tissue block face, providing color anatomy and molecular fluorescence 3D microscopic imaging over vast volumes as large as a whole mouse, with single-metastatic-cell sensitivity. We utilized DenseVNet from NiftyNet for multi-organ segmentation on color anatomy images to further analyze major organs. The proposed algorithm was trained/validated/tested on 70/5/4 color anatomy volumes with manually labeled lung, liver, and spleen. The mean Dice similarity coefficient for lung, liver, and spleen in the test set were 0.89 +/- 0.01, 0.92 +/- 0.01, and 0.83 +/- 0.04. We deem Dice coefficient of >0.9 good for analyzing distribution of metastases. To segment GFP-labeled breast cancer metastases in high resolution green fluorescence images, big and small candidates were segmented using marker-based watershed and multi-scale Laplacian of Gaussian filtering followed by Otsu segmentation respectively. A bounding box around each candidate was classified with a 3D convolutional neural network (CNN). In one test mouse with 226 metastases, CNN-based classification and random forest with hand-crafted features achieved sensitivity/specificity of 0.95/0.89 and 0.92/0.82, respectively. DenseVNet-based organ segmentation allows automatic quantification of GFP-labeled metastases in each organ of interest. In the test mouse with 226 metastases, 78 (1 with size >2mm, 21 with size 0.5mm-2mm, and 56 with size <0.5mm) and 24 (1 with size >2mm, 11 with size 0.5-2mm, and 12 with size <0.5mm) were found in the lung and liver respectively.
Segmentation of Brain Metastases in MRI: A Two-Stage Deep Learning Approach with Modality Impact Study

Yousef Sadegheih,Dorit Merhof

2024-07-19

Abstract:Brain metastasis segmentation poses a significant challenge in medical imaging due to the complex presentation and variability in size and location of metastases. In this study, we first investigate the impact of different imaging modalities on segmentation performance using a 3D U-Net. Through a comprehensive analysis, we determine that combining all available modalities does not necessarily enhance performance. Instead, the combination of T1-weighted with contrast enhancement (T1c), T1-weighted (T1), and FLAIR modalities yields superior results. Building on these findings, we propose a two-stage detection and segmentation model specifically designed to accurately segment brain metastases. Our approach demonstrates that leveraging three key modalities (T1c, T1, and FLAIR) achieves significantly higher accuracy compared to single-pass deep learning models. This targeted combination allows for precise segmentation, capturing even small metastases that other models often miss. Our model sets a new benchmark in brain metastasis segmentation, highlighting the importance of strategic modality selection and multi-stage processing in medical imaging. Our implementation is freely accessible to the research community on \href{<a class="link-external link-https" href="https://github.com/xmindflow/Met-Seg" rel="external noopener nofollow">this https URL</a>}{GitHub}.

Image and Video Processing
Fully convolutional neural network-based segmentation of brain metastases: a comprehensive approach for accurate detection and localization

Omar Farghaly,Priya Deshpande

DOI: https://doi.org/10.1007/s00521-024-10334-8

2024-08-18

Neural Computing and Applications

Abstract:Brain metastases present a formidable challenge in cancer management due to the infiltration of malignant cells from distant sites into the brain. Precise segmentation of brain metastases (BM) in medical imaging is vital for treatment planning and assessment. Leveraging deep learning techniques has shown promise in automating BM identification, facilitating faster and more accurate detection. This paper aims to develop an innovative novel deep learning model tailored for BM segmentation, addressing current approach limitations. Utilizing a comprehensive dataset of annotated magnetic resonance imaging (MRI) from Stanford University, the proposed model will undergo thorough evaluation using standard performance metrics. Comparative analysis with existing segmentation methods will highlight the superior performance and efficacy of our model. The anticipated outcome of this research is a highly accurate and efficient deep learning model for brain metastasis segmentation. Such a model holds potential to enhance treatment planning, monitoring, and ultimately improve patient care and clinical outcomes in managing brain metastases.

computer science, artificial intelligence
NIMG-43. LONGITUDINAL TRACKING AND GROWTH RATE CHARACTERIZATION OF BRAIN METASTASES ON MAGNETIC RESONANCE IMAGING

Jay Patel,Andrew Beers,Ken Chang,James Brown,Katharina Hoebel,Bruce Rosen,Raymond Huang,Priscilla Brastianos,Elizabeth Gerstner,Jayashree Kalpathy-Cramer

DOI: https://doi.org/10.1093/neuonc/noz175.713

2019-11-01

Abstract:Abstract PURPOSE Measuring treatment response is vital for assessing efficacy of treatment regimen for patients with brain metastases (BM). Unfortunately, manual delineation of all lesions on MRI across time-points is prohibitively time-consuming, making it infeasible to track individual lesion growth/shrinkage rates as part of the clinical workflow. To overcome this challenge, we propose a deep learning approach to segment all BM, and furthermore, show that certain brain regions are more prone to high-growth rate lesions. METHODS 163 longitudinal MRIs from 77 patients with MPRAGE-post contrast imaging protocol were prospectively obtained from Massachusetts General Hospital (MGH). An expert neuro-oncologist provided ground truth segmentations for all patients. A 3D U-Net architecture was trained to automatically segment BM; training was stopped when validation set Dice score plateaued to prevent overfitting. To enable lesion tracking, all time-points per patient were affinely registered to each other. Every lesion was subsequently classified based on its growth rate (responder: overall lesion shrinkage; inconclusive: 0% to 40% lesion growth; non-responder: more than 40% lesion growth). Characterization of global lesion growth rate patterns was accomplished by affinely registering all time-points to the MNI brain atlas. Segmented lesions were projected onto the atlas, which was qualitatively analyzed to identify spatial regions composed primarily of one class of lesion. RESULTS For automatic segmentation, we report a mean dice score of 0.778, 0.737, and 0.704 on training, validation, and testing sets respectively. Furthermore, we find that the largest BM with the highest average growth rate (non-responders) tend to be located in the posterior frontal/parietal lobes, while smaller, lower growth rate lesions (responders) tend to be localized in the frontal lobes. The posterior fossa was found to be heterogeneous in lesion size and growth rate. CONCLUSION We developed automatic metastatic lesion tracking over time-points and identified brain regions associated with differing growth rate lesions.

oncology,clinical neurology
A Large Open Access Dataset of Brain Metastasis 3D Segmentations with Clinical and Imaging Feature Information

Divya Ramakrishnan,Leon Jekel,Saahil Chadha,Anastasia Janas,Harrison Moy,Nazanin Maleki,Matthew Sala,Manpreet Kaur,Gabriel Cassinelli Petersen,Sara Merkaj,Marc von Reppert,Ujjwal Baid,Spyridon Bakas,Claudia Kirsch,Melissa Davis,Khaled Bousabarah,Wolfgang Holler,MingDe Lin,Malte Westerhoff,Sanjay Aneja,Fatima Memon,Mariam S. Aboian

2023-09-12

Abstract:Resection and whole brain radiotherapy (WBRT) are the standards of care for the treatment of patients with brain metastases (BM) but are often associated with cognitive side effects. Stereotactic radiosurgery (SRS) involves a more targeted treatment approach and has been shown to avoid the side effects associated with WBRT. However, SRS requires precise identification and delineation of BM. While many AI algorithms have been developed for this purpose, their clinical adoption has been limited due to poor model performance in the clinical setting. Major reasons for non-generalizable algorithms are the limitations in the datasets used for training the AI network. The purpose of this study was to create a large, heterogenous, annotated BM dataset for training and validation of AI models to improve generalizability. We present a BM dataset of 200 patients with pretreatment T1, T1 post-contrast, T2, and FLAIR MR images. The dataset includes contrast-enhancing and necrotic 3D segmentations on T1 post-contrast and whole tumor (including peritumoral edema) 3D segmentations on FLAIR. Our dataset contains 975 contrast-enhancing lesions, many of which are sub centimeter, along with clinical and imaging feature information. We used a streamlined approach to database-building leveraging a PACS-integrated segmentation workflow.

Quantitative Methods
Innv-02. Brainmets: A Clinician-Friendly Software To Manually Segment Brain Metastases And Detect Primary Tumor Origin Using Deep Learning

Suhrud Panchawagh

DOI: https://doi.org/10.1093/neuonc/noae165.0665

2024-11-29

Neuro-Oncology

Abstract:Estimates suggest that around 20%-40% of cancer patients are affected by brain metastases. A subset of these patients first present with central nervous system manifestations with an unknown primary. The issue then arises regarding which region of the body should be imaged, if not the entire body, exposing the patient to more radiation. To address this issue, streamline workflows, and save precious time, we developed a software clinicians can use to identify primary tumor locus. "BrainMets" is a user-friendly software that handles a DICOM input, allows the user to segment the region(s) of interest manually, and uses a deep learning model to predict the most likely tumor origin. The model is a mixed-effects neural network pre-trained on radiomic features from open-source data by Ocaña-Tienda et al. (2023) using 637 high-resolution imaging studies from 10 different medical centers with an accuracy of 90.5%, precision of 92.7%, recall of 87.8%, and F1 score of 90.2%. The software leverages the open-source software 3D-Slicer to help segment regions of interest, extract radiomic features, and make predictions. It is built using Flask, a Python package for backend development. The frontend user interface is created using HTML/CSS and Bootstrap. The "BrainMets" software thus strives to enhance diagnostic workflow significantly, reduce appointment times for scans, and improve patient experience. Future enhancements include integrating more AI models, improving healthcare IT system compatibility, and updating datasets to boost predictive accuracy and generalizability. This tool sets a new standard in personalized medicine, optimizing treatment strategies for cancer patients with brain metastases. As adoption increases, it could substantially improve patient outcomes and reduce healthcare costs associated with misdiagnosis and overtreatment. Further research and development will focus on expanding its applicability across various types of cancers.

oncology,clinical neurology
Two is better than one: longitudinal detection and volumetric evaluation of brain metastases after Stereotactic Radiosurgery with a deep learning pipeline

Yonny Hammer,Wenad Najjar,Lea Kahanov,Leo Joskowicz,Yigal Shoshan

DOI: https://doi.org/10.1007/s11060-024-04580-y

2024-02-03

Journal of Neuro-Oncology

Abstract:Close MRI surveillance of patients with brain metastases following Stereotactic Radiosurgery (SRS) treatment is essential for assessing treatment response and the current disease status in the brain. This follow-up necessitates the comparison of target lesion sizes in pre- (prior) and post-SRS treatment (current) T1W-Gad MRI scans. Our aim was to evaluate SimU-Net, a novel deep-learning model for the detection and volumetric analysis of brain metastases and their temporal changes in paired prior and current scans.

oncology,clinical neurology
Length-scale study in deep learning prediction for non-small cell lung cancer brain metastasis

Haowen Zhou,Steven,Mark Watson,Cory T. Bernadt,Oumeng Zhang,Ramaswamy Govindan,Richard J. Cote,Changhuei Yang

2024-06-02

Abstract:Deep learning assisted digital pathology has the potential to impact clinical practice in significant ways. In recent studies, deep neural network (DNN) enabled analysis outperforms human pathologists. Increasing sizes and complexity of the DNN architecture generally improves performance at the cost of DNN's explainability. For pathology, this lack of DNN explainability is particularly problematic as it hinders the broader clinical interpretation of the pathology features that may provide physiological disease insights. To better assess the features that DNN uses in developing predictive algorithms to interpret digital microscopic images, we sought to understand the role of resolution and tissue scale and here describe a novel method for studying the predictive feature length-scale that underpins a DNN's predictive power. We applied the method to study a DNN's predictive capability in the case example of brain metastasis prediction from early-stage non-small-cell lung cancer biopsy slides. The study highlights the DNN attention in the brain metastasis prediction targeting both cellular scale (resolution) and tissue scale features on H&E-stained histological whole slide images. At the cellular scale, we see that DNN's predictive power is progressively increased at higher resolution (i.e., lower resolvable feature length) and is largely lost when the resolvable feature length is longer than 5 microns. In addition, DNN uses more macro-scale features (maximal feature length) associated with tissue organization/architecture and is optimized when assessing visual fields larger than 41 microns. This study for the first time demonstrates the length-scale requirements necessary for optimal DNN learning on digital whole slide images.

Image and Video Processing,Computer Vision and Pattern Recognition
A Fully Automated Post-Surgical Brain Tumor Segmentation Model for Radiation Treatment Planning and Longitudinal Tracking

Karthik K. Ramesh,Karen M. Xu,Anuradha G. Trivedi,Vicki Huang,Vahid Khalilzad Sharghi,Lawrence R. Kleinberg,Eric A. Mellon,Hui-Kuo G. Shu,Hyunsuk Shim,Brent D. Weinberg

DOI: https://doi.org/10.3390/cancers15153956

2023-08-04

Cancers

Abstract:Glioblastoma (GBM) has a poor survival rate even with aggressive surgery, concomitant radiation therapy (RT), and adjuvant chemotherapy. Standard-of-care RT involves irradiating a lower dose to the hyperintense lesion in T2-weighted fluid-attenuated inversion recovery MRI (T2w/FLAIR) and a higher dose to the enhancing tumor on contrast-enhanced, T1-weighted MRI (CE-T1w). While there have been several attempts to segment pre-surgical brain tumors, there have been minimal efforts to segment post-surgical tumors, which are complicated by a resection cavity and postoperative blood products, and tools are needed to assist physicians in generating treatment contours and assessing treated patients on follow up. This report is one of the first to train and test multiple deep learning models for the purpose of post-surgical brain tumor segmentation for RT planning and longitudinal tracking. Post-surgical FLAIR and CE-T1w MRIs, as well as their corresponding RT targets (GTV1 and GTV2, respectively) from 225 GBM patients treated with standard RT were trained on multiple deep learning models including: Unet, ResUnet, Swin-Unet, 3D Unet, and Swin-UNETR. These models were tested on an independent dataset of 30 GBM patients with the Dice metric used to evaluate segmentation accuracy. Finally, the best-performing segmentation model was integrated into our longitudinal tracking web application to assign automated structured reporting scores using change in percent cutoffs of lesion volume. The 3D Unet was our best-performing model with mean Dice scores of 0.72 for GTV1 and 0.73 for GTV2 with a standard deviation of 0.17 for both in the test dataset. We have successfully developed a lightweight post-surgical segmentation model for RT planning and longitudinal tracking.

oncology
The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI

Ahmed W. Moawad,Anastasia Janas,Ujjwal Baid,Divya Ramakrishnan,Rachit Saluja,Nader Ashraf,Leon Jekel,Raisa Amiruddin,Maruf Adewole,Jake Albrecht,Udunna Anazodo,Sanjay Aneja,Syed Muhammad Anwar,Timothy Bergquist,Evan Calabrese,Veronica Chiang,Verena Chung,Gian Marco Marco Conte,Farouk Dako,James Eddy,Ivan Ezhov,Ariana Familiar,Keyvan Farahani,Juan Eugenio Iglesias,Zhifan Jiang,Elaine Johanson,Anahita Fathi Kazerooni,Florian Kofler,Kiril Krantchev,Dominic LaBella,Koen Van Leemput,Hongwei Bran Li,Marius George Linguraru,Katherine E. Link,Xinyang Liu,Nazanin Maleki,Zeke Meier,Bjoern H Menze,Harrison Moy,Klara Osenberg,Marie Piraud,Zachary Reitman,Russel Takeshi Shinohara,Nourel hoda Tahon,Ayman Nada,Yuri S. Velichko,Chunhao Wang,Benedikt Wiestler,Walter Wiggins,Umber Shafique,Klara Willms,Arman Avesta,Khaled Bousabarah,Satrajit Chakrabarty,Nicolo Gennaro,Wolfgang Holler,Manpreet Kaur,Pamela LaMontagne,MingDe Lin,Jan Lost,Daniel S. Marcus,Ryan Maresca,Sarah Merkaj,Ayaman Nada,Gabriel Cassinelli Pedersen,Marc von Reppert,Aristeidis Sotiras,Oleg Teytelboym,Niklas Tillmans,Malte Westerhoff,Ayda Youssef,Devon Godfrey,Scott Floyd,Andreas Rauschecker,Javier Villanueva-Meyer,Irada Pflüger,Jaeyoung Cho,Martin Bendszus,Gianluca Brugnara,Justin Cramer,Gloria J. Guzman Perez-Carillo,Derek R. Johnson,Anthony Kam,Benjamin Yin Ming Kwan,Lillian Lai,Neil U. Lall,Fatima Memon,Satya Narayana Patro,Bojan Petrovic,Tiffany Y. So,Gerard Thompson,Lei Wu,E. Brooke Schrickel,Anu Bansal,Frederik Barkhof,Cristina Besada,Sammy Chu,Jason Druzgal,Alexandru Dusoi,Luciano Farage,et al. (131 additional authors not shown)

2024-06-18

Abstract:The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space.The BraTS-METS 2023 challenge successfully curated well-annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied clinical environments and providing personalized volumetric reports to patients undergoing BM treatment.

Other Quantitative Biology,Image and Video Processing
A transformer-based deep learning approach for classifying brain metastases into primary organ sites using clinical whole brain MRI

Qing Lyu,Sanjeev V. Namjoshi,Emory McTyre,Umit Topaloglu,Richard Barcus,Michael D. Chan,Christina K. Cramer,Waldemar Debinski,Metin N. Gurcan,Glenn J. Lesser,Hui-Kuan Lin,Reginald F. Munden,Boris C. Pasche,Kiran Kumar Solingapuram Sai,Roy E. Strowd,Stephen B. Tatter,Kounosuke Watabe,Wei Zhang,Ge Wang,Christopher T. Whitlow

DOI: https://doi.org/10.48550/arXiv.2110.03588

2022-04-21

Abstract:Treatment decisions for brain metastatic disease rely on knowledge of the primary organ site, and currently made with biopsy and histology. Here we develop a novel deep learning approach for accurate non-invasive digital histology with whole-brain MRI data. Our IRB-approved single-site retrospective study was comprised of patients (n=1,399) referred for MRI treatment-planning and gamma knife radiosurgery over 21 years. Contrast-enhanced T1-weighted and T2-weighted Fluid-Attenuated Inversion Recovery brain MRI exams (n=1,582) were preprocessed and input to the proposed deep learning workflow for tumor segmentation, modality transfer, and primary site classification into one of five classes. Ten-fold cross-validation generated overall AUC of 0.878 (95%CI:0.873,0.883), lung class AUC of 0.889 (95%CI:0.883,0.895), breast class AUC of 0.873 (95%CI:0.860,0.886), melanoma class AUC of 0.852 (95%CI:0.842,0.862), renal class AUC of 0.830 (95%CI:0.809,0.851), and other class AUC of 0.822 (95%CI:0.805,0.839). These data establish that whole-brain imaging features are discriminative to allow accurate diagnosis of the primary organ site of malignancy. Our end-to-end deep radiomic approach has great potential for classifying metastatic tumor types from whole-brain MRI images. Further refinement may offer an invaluable clinical tool to expedite primary cancer site identification for precision treatment and improved outcomes.

Image and Video Processing,Computer Vision and Pattern Recognition,Medical Physics
Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features

Xue Feng,Nicholas J. Tustison,Sohil H. Patel,Craig H. Meyer

DOI: https://doi.org/10.3389/fncom.2020.00025

IF: 3.387

2020-04-08

Frontiers in Computational Neuroscience

Abstract:Accurate segmentation of different sub-regions of gliomas such as peritumoral edema, necrotic core, enhancing, and non-enhancing tumor core from multimodal MRI scans has important clinical relevance in diagnosis, prognosis and treatment of brain tumors. However, due to the highly heterogeneous appearance and shape of these tumors, segmentation of the sub-regions is challenging. Recent developments using deep learning models has proved its effectiveness in various semantic and medical image segmentation tasks, many of which are based on the U-Net network structure with symmetric encoding and decoding paths for end-to-end segmentation due to its high efficiency and good performance. In brain tumor segmentation, the 3D nature of multimodal MRI poses challenges such as memory and computation limitations and class imbalance when directly adopting the U-Net structure. In this study we aim to develop a deep learning model using a 3D U-Net with adaptations in the training and testing strategies, network structures, and model parameters for brain tumor segmentation. Furthermore, instead of picking one best model, an ensemble of multiple models trained with different hyper-parameters are used to reduce random errors from each model and yield improved performance. Preliminary results demonstrate the effectiveness of this method and achieved the 9th place in the very competitive 2018 Multimodal Brain Tumor Segmentation (BraTS) challenge. In addition, to emphasize the clinical value of the developed segmentation method, a linear model based on the radiomics features extracted from segmentation and other clinical features are developed to predict patient overall survival. Evaluation of these innovations shows high prediction accuracy in both low-grade glioma and glioblastoma patients, which achieved the 1st place in the 2018 BraTS challenge.

neurosciences,mathematical & computational biology
Automated segmentation of brain metastases with deep learning: A multi-center, randomized crossover, multi-reader evaluation study

Xiao Luo,Yadi Yang,Shaohan Yin,Hui Li,Ying Shao,Dechun Zheng,Xinchun Li,Jianpeng Li,Weixiong Fan,Jing Li,Xiaohua Ban,Shanshan Lian,Yun Zhang,Qiuxia Yang,Weijing Zhang,Cheng Zhang,Lidi Ma,Yingwei Luo,Fan Zhou,Shiyuan Wang,Cuiping Lin,Jiao Li,Ma Luo,Jianxun He,Guixiao Xu,Yaozong Gao,Dinggang Shen,Ying Sun,Yonggao Mou,Rong Zhang,Chuanmiao Xie

DOI: https://doi.org/10.1093/neuonc/noae113

2024-11-04

Abstract:Background: Artificial intelligence has been proposed for brain metastasis (BM) segmentation but it has not been fully clinically validated. The aim of this study was to develop and evaluate a system for BM segmentation. Methods: A deep-learning-based BM segmentation system (BMSS) was developed using contrast-enhanced MR images from 488 patients with 10338 brain metastases. A randomized crossover, multi-reader study was then conducted to evaluate the performance of the BMSS for BM segmentation using data prospectively collected from 50 patients with 203 metastases at 5 centers. Five radiology residents and 5 attending radiologists were randomly assigned to contour the same prospective set in assisted and unassisted modes. Aided and unaided Dice similarity coefficients (DSCs) and contouring times per lesion were compared. Results: The BMSS alone yielded a median DSC of 0.91 (95% confidence interval, 0.90-0.92) in the multi-center set and showed comparable performance between the internal and external sets (P = .67). With BMSS assistance, the readers increased the median DSC from 0.87 (0.87-0.88) to 0.92 (0.92-0.92) (P < .001) with a median time saving of 42% (40-45%) per lesion. Resident readers showed a greater improvement than attending readers in contouring accuracy (improved median DSC, 0.05 [0.05-0.05] vs 0.03 [0.03-0.03]; P < .001), but a similar time reduction (reduced median time, 44% [40-47%] vs 40% [37-44%]; P = .92) with BMSS assistance. Conclusions: The BMSS can be optimally applied to improve the efficiency of brain metastasis delineation in clinical practice.
A Large Scale Multi-dataset Investigation of Brain Metastases Distribution Based on Primary Cancer Type

Qing Lyu,Hongyu Yuan,Zhen Lin,Richard Barcus,Jeremy Hudson,Yuming Jiang,Jeongchul Kim,Christopher T Whitlow

DOI: https://doi.org/10.1101/2024.09.30.24314304

2024-10-01

Abstract:Brain metastases (BM) present a significant clinical challenge, characterized by poor prognosis and high morbidity. Previous research has demonstrated heterogeneous distribution patterns of BMs depending on the primary tumor type. This study aims to further investigate the distribution patterns of BMs. Utilizing three public datasets and one private dataset, we analyzed 1,344 patients with a total of 9,431 identified BMs, categorizing them into lung, breast, melanoma, kidney cancer, and other groups. Our findings indicate that lung cancer BMs predominantly localize in the cerebellum, as well as the frontal, temporal, occipital, and parietal lobes. Breast cancer BMs are commonly found in the cerebellum, frontal, occipital, and temporal lobes, while melanoma BMs are most frequently located in the occipital, temporal, and frontal lobes. Kidney cancer BMs, less studied in existing literature, primarily affect the frontal and temporal lobes. Additionally, we explored the relationship between BM volume and tumor type, revealing that lung and breast cancer BMs are more likely to have smaller tumor volumes compared to melanoma and kidney cancer BMs. These findings confirm and expand upon previous research, offering new insights into the distribution and characteristics of kidney cancer BMs.

Oncology
Model Ensemble for Brain Tumor Segmentation in Magnetic Resonance Imaging

Daniel Capellán-Martín,Zhifan Jiang,Abhijeet Parida,Xinyang Liu,Van Lam,Hareem Nisar,Austin Tapp,Sarah Elsharkawi,Maria J. Ledesma-Carbayo,Syed Muhammad Anwar,Marius George Linguraru

2024-09-13

Abstract:Segmenting brain tumors in multi-parametric magnetic resonance imaging enables performing quantitative analysis in support of clinical trials and personalized patient care. This analysis provides the potential to impact clinical decision-making processes, including diagnosis and prognosis. In 2023, the well-established Brain Tumor Segmentation (BraTS) challenge presented a substantial expansion with eight tasks and 4,500 brain tumor cases. In this paper, we present a deep learning-based ensemble strategy that is evaluated for newly included tumor cases in three tasks: pediatric brain tumors (PED), intracranial meningioma (MEN), and brain metastases (MET). In particular, we ensemble outputs from state-of-the-art nnU-Net and Swin UNETR models on a region-wise basis. Furthermore, we implemented a targeted post-processing strategy based on a cross-validated threshold search to improve the segmentation results for tumor sub-regions. The evaluation of our proposed method on unseen test cases for the three tasks resulted in lesion-wise Dice scores for PED: 0.653, 0.809, 0.826; MEN: 0.876, 0.867, 0.849; and MET: 0.555, 0.6, 0.58; for the enhancing tumor, tumor core, and whole tumor, respectively. Our method was ranked first for PED, third for MEN, and fourth for MET, respectively.

Image and Video Processing,Computer Vision and Pattern Recognition
Enhancing brain metastasis prediction in non-small cell lung cancer: a deep learning-based segmentation and CT radiomics-based ensemble learning model

Jing Gong,Ting Wang,Zezhou Wang,Xiao Chu,Tingdan Hu,Menglei Li,Weijun Peng,Feng Feng,Tong Tong,Yajia Gu

DOI: https://doi.org/10.1186/s40644-023-00623-1

IF: 5.605

2024-01-03

Cancer Imaging

Abstract:Brain metastasis (BM) is most common in non-small cell lung cancer (NSCLC) patients. This study aims to enhance BM risk prediction within three years for advanced NSCLC patients by using a deep learning-based segmentation and computed tomography (CT) radiomics-based ensemble learning model.

oncology,radiology, nuclear medicine & medical imaging

[A case of diffuse peritonitis with hemolytic hepato-renal syndrome after abortion].

Deep learning ensembles for detecting brain metastases in longitudinal multi-modal MRI studies

Deep learning for brain metastasis detection and segmentation in longitudinal MRI data

2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data

Deep Learning Based Multi-Organ Segmentation And Metastases Segmentation In Whole Mouse Body And The Cryo-Imaging Cancer Imaging And Therapy Analysis Platform (Citap)

Segmentation of Brain Metastases in MRI: A Two-Stage Deep Learning Approach with Modality Impact Study

Fully convolutional neural network-based segmentation of brain metastases: a comprehensive approach for accurate detection and localization

NIMG-43. LONGITUDINAL TRACKING AND GROWTH RATE CHARACTERIZATION OF BRAIN METASTASES ON MAGNETIC RESONANCE IMAGING

A Large Open Access Dataset of Brain Metastasis 3D Segmentations with Clinical and Imaging Feature Information

Innv-02. Brainmets: A Clinician-Friendly Software To Manually Segment Brain Metastases And Detect Primary Tumor Origin Using Deep Learning

Two is better than one: longitudinal detection and volumetric evaluation of brain metastases after Stereotactic Radiosurgery with a deep learning pipeline

Length-scale study in deep learning prediction for non-small cell lung cancer brain metastasis

A Fully Automated Post-Surgical Brain Tumor Segmentation Model for Radiation Treatment Planning and Longitudinal Tracking

The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI

A transformer-based deep learning approach for classifying brain metastases into primary organ sites using clinical whole brain MRI

Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features

Automated segmentation of brain metastases with deep learning: A multi-center, randomized crossover, multi-reader evaluation study

A Large Scale Multi-dataset Investigation of Brain Metastases Distribution Based on Primary Cancer Type

Model Ensemble for Brain Tumor Segmentation in Magnetic Resonance Imaging

Enhancing brain metastasis prediction in non-small cell lung cancer: a deep learning-based segmentation and CT radiomics-based ensemble learning model