Abstract:High-grade gliomas are the most aggressive malignant brain tumors. Accurate pre-operative prognosis for this cohort can lead to better treatment planning. Conventional survival prediction based on clinical information is subjective and could be inaccurate. Recent radiomics studies have shown better prognosis by using carefully-engineered image features from magnetic resonance images (MRI). However, feature engineering is usually time consuming, laborious and subjective. Most importantly, the engineered features cannot effectively encode other predictive but implicit information provided by multi-modal neuroimages. We propose a two-stage learning-based method to predict the overall survival (OS) time of high-grade gliomas patient. At the first stage, we adopt deep learning, a recently dominant technique of artificial intelligence, to automatically extract implicit and high-level features from multi-modal, multi-channel preoperative MRI such that the features are competent of predicting survival time. Specifically, we utilize not only contrast-enhanced T1 MRI, but also diffusion tensor imaging (DTI) and resting-state functional MRI (rs-fMRI), for computing multiple metric maps (including various diffusivity metric maps derived from DTI, and also the frequency-specific brain fluctuation amplitude maps and local functional connectivity anisotropy-related metric maps derived from rs-fMRI) from 68 high-grade glioma patients with different survival time. We propose a multi-channel architecture of 3D convolutional neural networks (CNNs) for deep learning upon those metric maps, from which high-level predictive features are extracted for each individual patch of these maps. At the second stage, those deeply learned features along with the pivotal limited demographic and tumor-related features (such as age, tumor size and histological type) are fed into a support vector machine (SVM) to generate the final prediction result (i.e., long or short overall survival time). The experimental results demonstrate that this multi-model, multi-channel deep survival prediction framework achieves an accuracy of 90.66%, outperforming all the competing methods. This study indicates highly demanded effectiveness on prognosis of deep learning technique in neuro-oncological applications for better individualized treatment planning towards precision medicine.

Exploring Deep Features from Brain Tumor Magnetic Resonance Images Via Transfer Learning.

Deep Learning and Transfer Learning for Brain Tumor Detection and Classification

Multi-Channel 3D Deep Feature Learning for Survival Time Prediction of Brain Tumor Patients Using Multi-Modal Neuroimages

Improving Effectiveness of Different Deep Transfer Learning-Based Models for Detecting Brain Tumors From MR Images

Deep Learning versus Classical Regression for Brain Tumor Patient Survival Prediction

Brain Tumor Classification Using Deep Neural Network and Transfer Learning

Isolated Convolutional-Neural-Network-Based Deep-Feature Extraction for Brain Tumor Classification Using Shallow Classifier

Employing deep learning and transfer learning for accurate brain tumor detection

Ensemble deep learning for brain tumor detection

Brain Tumor Classification Using Pretained Deep Convolutional Neural Networks

Brain tumor classification using fine-tuned transfer learning models on magnetic resonance imaging (MRI) images

A New Deep Hybrid Boosted and Ensemble Learning-Based Brain Tumor Analysis Using MRI

A Deep Transfer Learning Based Architecture for Brain Tumor Classification Using MR Images

An enhanced deep learning method for multi-class brain tumor classification using deep transfer learning

Efficient framework for brain tumor detection using different deep learning techniques

Brain Tumor Detection Using Deep Learning Approaches

Efficient deep learning models for brain tumor detection with segmentation and data augmentation techniques

Recurrent Neural Network Deep Learning Techniques for Brain Tumor Segmentation and Classification of Magnetic Resonance Imaging Images

Deep Radiomics for Brain Tumor Detection and Classification from Multi-Sequence MRI

Feature Extraction Using a Residual Deep Convolutional Neural Network (ResNet-152) and Optimized Feature Dimension Reduction for MRI Brain Tumor Classification

Multi-modal fusion deep transfer learning for accurate brain tumor classification using magnetic resonance imaging images