Multimodal Data Integration Using Deep Learning Predicts Overall Survival of Patients with Glioma
Yifan Yuan,Xuan Zhang,Yining Wang,Hongyan Li,Zengxin Qi,Zunguo Du,Ying-Hua Chu,Danyang Feng,Jie Hu,Qingguo Xie,Jianping Song,Yuqing Liu,Jiajun Cai
DOI: https://doi.org/10.1002/viw.20240001
2024-01-01
View
Abstract:Gliomas are highly heterogenous diseases with poor prognosis. Precise survival prediction could benefit further clinical decision-making, clinical trial incursion, and health economics. Recent research has emphasized the prognostic value of magnetic resonance imaging, pathological specimens, and circulating biomarkers. However, the integrative potential and efficacy of these modalities require to be further validated. After incorporating 218 patients of The Cancer Genome Atlas glioma datasets of and 54 patients of the Huashan cohort with complementary prognostic information, we established a squeeze-and-excitation deep learning feature extractor for T1-contrast enhanced images and histological slides and explored to screen significant circulating 5-hydroxymethylcytosines (5hmC) profiles for glioma survival by least absolute shrinkage and selection operator-Cox regression. Therefore, a prognostication predictive model with high efficiency was obtained through survival support vector machine multimodal integration of radiologic imaging, histopathologic imaging features, genome-wide 5hmC in circulating cell-free DNA and clinical variables, suggesting a valid strategy (concordance-index = 0.897; Brier score = 0.118) for improved survival risk stratification of glioma patients. Gliomas are highly heterogenous diseases with poor prognosis; precise survival prediction could benefit clinical decision-making, clinical trial incursion, and health economics. Based on The Cancer Genome Atlas glioma database and the cohort of Huashan Hospital, this research included multimodal data and constructed a "squeeze and excitation deep learning feature extractor" that can realize magnetic resonance imaging, pathological images, and liquid biopsy sequencing fusion. Further, we established a "survival support vector machine-multimodal predictor" model, which was promising to predict overall survival time and provide a reference for postoperative treatment and decision-making in glioma patients. image