Abstract:Gliomas are highly heterogenous diseases with poor prognosis. Precise survival prediction could benefit further clinical decision-making, clinical trial incursion, and health economics. Recent research has emphasized the prognostic value of magnetic resonance imaging, pathological specimens, and circulating biomarkers. However, the integrative potential and efficacy of these modalities require to be further validated. After incorporating 218 patients of The Cancer Genome Atlas glioma datasets of and 54 patients of the Huashan cohort with complementary prognostic information, we established a squeeze-and-excitation deep learning feature extractor for T1-contrast enhanced images and histological slides and explored to screen significant circulating 5-hydroxymethylcytosines (5hmC) profiles for glioma survival by least absolute shrinkage and selection operator-Cox regression. Therefore, a prognostication predictive model with high efficiency was obtained through survival support vector machine multimodal integration of radiologic imaging, histopathologic imaging features, genome-wide 5hmC in circulating cell-free DNA and clinical variables, suggesting a valid strategy (concordance-index = 0.897; Brier score = 0.118) for improved survival risk stratification of glioma patients. Gliomas are highly heterogenous diseases with poor prognosis; precise survival prediction could benefit clinical decision-making, clinical trial incursion, and health economics. Based on The Cancer Genome Atlas glioma database and the cohort of Huashan Hospital, this research included multimodal data and constructed a "squeeze and excitation deep learning feature extractor" that can realize magnetic resonance imaging, pathological images, and liquid biopsy sequencing fusion. Further, we established a "survival support vector machine-multimodal predictor" model, which was promising to predict overall survival time and provide a reference for postoperative treatment and decision-making in glioma patients. image

Multiview Deep Forest for Overall Survival Prediction in Cancer.

Multiview Deep Learning-based Efficient Medical Data Management for Survival Time Forecasting

Deep Semisupervised Multitask Learning Model and Its Interpretability for Survival Analysis.

PMDF: Preference-based Multimodal Deep Forest for Overall Survival Prediction in Gastric Cancer.

FORESEE: Multimodal and Multi-view Representation Learning for Robust Prediction of Cancer Survival

Deep Correlational Learning for Survival Prediction from Multi-modality Data.

MMHG: Multi-modal Hypergraph Learning for Overall Survival after D2 Gastrectomy for Gastric Cancer.

APDF: An active preference-based deep forest expert system for overall survival prediction in gastric cancer

Learning Comprehensive Multimodal Representation for Cancer Survival Prediction

Machine Learning–Based Overall Survival Prediction of Elderly Patients With Multiple Myeloma From Multicentre Real-Life Data

Smart Biosensor for Breast Cancer Survival Prediction Based on Multi-View Multi-Way Graph Learning

Colorectal cancer survival prediction using deep distribution based multiple-instance learning

A multi-view co-training network for semi-supervised medical image-based prognostic prediction

Multimodal Deep Learning for Cancer Survival Prediction: A Review

Long-term cancer survival prediction using multimodal deep learning

Multi-View Attention Learning for Residual Disease Prediction of Ovarian Cancer

DeepMMSA: A Novel Multimodal Deep Learning Method for Non-small Cell Lung Cancer Survival Analysis

M2EF-NNs: Multimodal Multi-instance Evidence Fusion Neural Networks for Cancer Survival Prediction

Pancancer survival prediction using a deep learning architecture with multimodal representation and integration

Deep learning-based multi-modal data integration enhancing breast cancer disease-free survival prediction

Multimodal Data Integration Using Deep Learning Predicts Overall Survival of Patients with Glioma