Abstract:High-grade gliomas are the most aggressive malignant brain tumors. Accurate pre-operative prognosis for this cohort can lead to better treatment planning. Conventional survival prediction based on clinical information is subjective and could be inaccurate. Recent radiomics studies have shown better prognosis by using carefully-engineered image features from magnetic resonance images (MRI). However, feature engineering is usually time consuming, laborious and subjective. Most importantly, the engineered features cannot effectively encode other predictive but implicit information provided by multi-modal neuroimages. We propose a two-stage learning-based method to predict the overall survival (OS) time of high-grade gliomas patient. At the first stage, we adopt deep learning, a recently dominant technique of artificial intelligence, to automatically extract implicit and high-level features from multi-modal, multi-channel preoperative MRI such that the features are competent of predicting survival time. Specifically, we utilize not only contrast-enhanced T1 MRI, but also diffusion tensor imaging (DTI) and resting-state functional MRI (rs-fMRI), for computing multiple metric maps (including various diffusivity metric maps derived from DTI, and also the frequency-specific brain fluctuation amplitude maps and local functional connectivity anisotropy-related metric maps derived from rs-fMRI) from 68 high-grade glioma patients with different survival time. We propose a multi-channel architecture of 3D convolutional neural networks (CNNs) for deep learning upon those metric maps, from which high-level predictive features are extracted for each individual patch of these maps. At the second stage, those deeply learned features along with the pivotal limited demographic and tumor-related features (such as age, tumor size and histological type) are fed into a support vector machine (SVM) to generate the final prediction result (i.e., long or short overall survival time). The experimental results demonstrate that this multi-model, multi-channel deep survival prediction framework achieves an accuracy of 90.66%, outperforming all the competing methods. This study indicates highly demanded effectiveness on prognosis of deep learning technique in neuro-oncological applications for better individualized treatment planning towards precision medicine.

Domain Knowledge Based Brain Tumor Segmentation and Overall Survival Prediction

Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features

3D Semantic Segmentation of Brain Tumor for Overall Survival Prediction

Brain-wise Tumor Segmentation and Patient Overall Survival Prediction.

Overall Survival Prediction for Gliomas Using a Novel Compound Approach.

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning

Multi-Channel 3D Deep Feature Learning for Survival Time Prediction of Brain Tumor Patients Using Multi-Modal Neuroimages

Glioma Prognosis: Segmentation of the Tumor and Survival Prediction using Shape, Geometric and Clinical Information

Application of Deep Learning Technology in Glioma

Leveraging segmentation-guided spatial feature embedding for overall survival prediction in glioblastoma with multimodal magnetic resonance imaging

DRRNet: Dense Residual Refine Networks for Automatic Brain Tumor Segmentation

3d u-net based brain tumor segmentation and survival days prediction

Brain-wise Tumor Segmentation and Patient Overall Survival Prediction

Automatic Brain Tumor Segmentation And Overall Survival Prediction Using Machine Learning Algorithms

Glioblastoma Tumor Segmentation using an Ensemble of Vision Transformers

Gradient-assisted deep model for brain tumor segmentation by multi-modality MRI volumes

SurvNet: A low-complexity convolutional neural network for survival time classification of patients with glioblastoma

U-Net Based Segmentation and Characterization of Gliomas

MMMNA-Net for Overall Survival Time Prediction of Brain Tumor Patients

Brain tumour segmentation and survival prognostication using 3D radiomics features and machine learning algorithms

Automatic Semantic Segmentation of Brain Gliomas from MRI Images Using a Deep Cascaded Neural Network