Abstract:High-grade gliomas are the most aggressive malignant brain tumors. Accurate pre-operative prognosis for this cohort can lead to better treatment planning. Conventional survival prediction based on clinical information is subjective and could be inaccurate. Recent radiomics studies have shown better prognosis by using carefully-engineered image features from magnetic resonance images (MRI). However, feature engineering is usually time consuming, laborious and subjective. Most importantly, the engineered features cannot effectively encode other predictive but implicit information provided by multi-modal neuroimages. We propose a two-stage learning-based method to predict the overall survival (OS) time of high-grade gliomas patient. At the first stage, we adopt deep learning, a recently dominant technique of artificial intelligence, to automatically extract implicit and high-level features from multi-modal, multi-channel preoperative MRI such that the features are competent of predicting survival time. Specifically, we utilize not only contrast-enhanced T1 MRI, but also diffusion tensor imaging (DTI) and resting-state functional MRI (rs-fMRI), for computing multiple metric maps (including various diffusivity metric maps derived from DTI, and also the frequency-specific brain fluctuation amplitude maps and local functional connectivity anisotropy-related metric maps derived from rs-fMRI) from 68 high-grade glioma patients with different survival time. We propose a multi-channel architecture of 3D convolutional neural networks (CNNs) for deep learning upon those metric maps, from which high-level predictive features are extracted for each individual patch of these maps. At the second stage, those deeply learned features along with the pivotal limited demographic and tumor-related features (such as age, tumor size and histological type) are fed into a support vector machine (SVM) to generate the final prediction result (i.e., long or short overall survival time). The experimental results demonstrate that this multi-model, multi-channel deep survival prediction framework achieves an accuracy of 90.66%, outperforming all the competing methods. This study indicates highly demanded effectiveness on prognosis of deep learning technique in neuro-oncological applications for better individualized treatment planning towards precision medicine.

Deep synergetic spiking neural P systems for the overall survival time prediction of glioblastoma patients

Generating Hypergraph-Based High-Order Representations of Whole-Slide Histopathological Images for Survival Prediction

Pre-operative Overall Survival Time Prediction for Glioblastoma Patients Using Deep Learning on Both Imaging Phenotype and Genotype

Multi-Channel 3D Deep Feature Learning for Survival Time Prediction of Brain Tumor Patients Using Multi-Modal Neuroimages

Domain Knowledge Based Brain Tumor Segmentation and Overall Survival Prediction

NIMG-60. PREDICTING OVERALL SURVIVAL IN GLIOBLASTOMA USING HISTOPATHOLOGY VIA AN END-TO-END DEEP LEARNING PIPELINE: A LARGE MULTI-COHORT STUDY

Non‐invasive prediction of overall survival time for glioblastoma multiforme patients based on multimodal MRI radiomics

Overall Survival Time Prediction for High Grade Gliomas Based on Sparse Representation Framework.

Multimodal Data Integration Using Deep Learning Predicts Overall Survival of Patients with Glioma

Overall Survival Time Prediction for High-Grade Glioma Patients Based on Large-Scale Brain Functional Networks.

MMMNA-Net for Overall Survival Time Prediction of Brain Tumor Patients

Ensemble Learning for Glioma Patients Overall Survival Prediction Using Pre-Operative MRIs

Predicting Overall Survival of Glioblastoma Patients Using Deep Learning Classification Based on MRIs

Leveraging segmentation-guided spatial feature embedding for overall survival prediction in glioblastoma with multimodal magnetic resonance imaging

Dual-stream multi-dependency graph neural network enables precise cancer survival analysis

Radiogenomics based survival prediction of small-sample glioblastoma patients by multi-task DFFSP model

Survival Prediction of Patients Suffering from Glioblastoma Based on Two-Branch DenseNet Using Multi-Channel Features.

Big-Hypergraph Factorization Neural Network for Survival Prediction From Whole Slide Image

An automatic deep learning-based workflow for glioblastoma survival prediction using pre-operative multimodal MR images

Segmentation then Prediction: A Multi-task Solution to Brain Tumor Segmentation and Survival Prediction

SurvNet: A low-complexity convolutional neural network for survival time classification of patients with glioblastoma