Abstract:Objectives: Glioblastoma (GBM) and brain metastases (BMs) are the two most common malignant brain tumors in adults. Magnetic resonance imaging (MRI) is a commonly used method for screening and evaluating the prognosis of brain tumors, but the specificity and sensitivity of conventional MRI sequences in differential diagnosis of GBM and BMs are limited. In recent years, deep neural network has shown great potential in the realization of diagnostic classification and the establishment of clinical decision support system. This study aims to apply the radiomics features extracted by deep learning techniques to explore the feasibility of accurate preoperative classification for newly diagnosed GBM and solitary brain metastases (SBMs), and to further explore the impact of multimodality data fusion on classification tasks. Methods: Standard protocol cranial MRI sequence data from 135 newly diagnosed GBM patients and 73 patients with SBMs confirmed by histopathologic or clinical diagnosis were retrospectively analyzed. First, structural T1-weight, T1C-weight, and T2-weight were selected as 3 inputs to the entire model, regions of interest (ROIs) were manually delineated on the registered three modal MR images, and multimodality radiomics features were obtained, dimensions were reduced using a random forest (RF)-based feature selection method, and the importance of each feature was further analyzed. Secondly, we used the method of contrast disentangled to find the shared features and complementary features between different modal features. Finally, the response of each sample to GBM and SBMs was predicted by fusing 2 features from different modalities. Results: The radiomics features using machine learning and the multi-modal fusion method had a good discriminatory ability for GBM and SBMs. Furthermore, compared with single-modal data, the multimodal fusion models using machine learning algorithms such as support vector machine (SVM), Logistic regression, RF, adaptive boosting (AdaBoost), and gradient boosting decision tree (GBDT) achieved significant improvements, with area under the curve (AUC) values of 0.974, 0.978, 0.943, 0.938, and 0.947, respectively; our comparative disentangled multi-modal MR fusion method performs well, and the results of AUC, accuracy (ACC), sensitivity (SEN) and specificity(SPE) in the test set were 0.985, 0.984, 0.900, and 0.990, respectively. Compared with other multi-modal fusion methods, AUC, ACC, and SEN in this study all achieved the best performance. In the ablation experiment to verify the effects of each module component in this study, AUC, ACC, and SEN increased by 1.6%, 10.9% and 15.0%, respectively after 3 loss functions were used simultaneously. Conclusions: A deep learning-based contrast disentangled multi-modal MR radiomics feature fusion technique helps to improve GBM and SBMs classification accuracy.

A Novel MKL Method for GBM Prognosis Prediction by Integrating Histopathological Image and Multi-Omics Data

Improve Glioblastoma Multiforme Prognosis Prediction by Using Feature Selection and Multiple Kernel Learning

The Comparison Genomics Analysis with Glioblastoma Multiforme (GBM) Cells under 3D and 2D Cell Culture Conditions

Integrating genomic data and pathological images to effectively predict breast cancer clinical outcome

Multi-Label Nonlinear Matrix Completion with Transductive Multi-Task Feature Selection for Joint MGMT and IDH1 Status Prediction of Patient with High-Grade Gliomas

Multimodal Survival Ensemble Network: Integrating Genomic and Histopathological Insights for Enhanced Cancer Prognosis.

Multi-label Inductive Matrix Completion for Joint MGMT and IDH1 Status Prediction for Glioma Patients

Multi-modal learning for predicting the genotype of glioma

Biologically interpretable multi-task deep learning pipeline predicts molecular alterations, grade, and prognosis in glioma patients

Predicting glioblastoma molecular subtypes and prognosis with a multimodal model integrating convolutional neural network, radiomics, and semantics

Pre-operative Overall Survival Time Prediction for Glioblastoma Patients Using Deep Learning on Both Imaging Phenotype and Genotype

Identification and validation of a novel robust glioblastoma prognosis model based on bioinformatics

Multiple Survival Outcome Prediction of Glioblastoma Patients Based on Multiparametric MRI

Exploring the prognostic value and biological pathways of transcriptomics and radiomics patterns in glioblastoma multiforme

Integrating Somatic Mutations for Breast Cancer Survival Prediction Using Machine Learning Methods

Multimodal Deep Learning-Based Prognostication in Glioma Patients: A Systematic Review

Multi-omics approaches establishing histone modification based prognostic model in glioma patients and further verification of the carcinogenesis mechanism

Prediction of overall survival and molecular markers in gliomas via analysis of digital pathology images using deep learning

Development and validation of a multi-modality fusion deep learning model for differentiating glioblastoma from solitary brain metastases

AI Deployment on GBM Diagnosis: A Novel Approach to Analyze Histopathological Images Using Image Feature-Based Analysis

Hyperpolarized Magnetic Resonance Imaging, Nuclear Magnetic Resonance Metabolomics, and Artificial Intelligence to Interrogate the Metabolic Evolution of Glioblastoma