Abstract:Background: Saliency-based algorithms are able to explain the relationship between input image pixels and deep-learning model predictions. However, it may be difficult to assess the clinical value of the most important image features and the model predictions derived from the raw saliency map. This study proposes to enhance the interpretability of saliency-based deep learning model for survival classification of patients with gliomas, by extracting domain knowledge-based information from the raw saliency maps. Materials and methods: Our study includes presurgical T1-weighted (pre- and post-contrast), T2-weighted and T2-FLAIR MRIs of 147 glioma patients from the BraTs 2020 challenge dataset aligned to the SRI 24 anatomical atlas. Each image exam includes a segmentation mask and the information of overall survival (OS) from time of diagnosis (in days). This dataset was divided into training ([Formula: see text]) and validation ([Formula: see text]) datasets. The extent of surgical resection for all patients was gross total resection. We categorized the data into 42 short (mean [Formula: see text] days), 30 medium ([Formula: see text] days), and 46 long ([Formula: see text] days) survivors. A 3D convolutional neural network (CNN) trained on brain tumour MRI volumes classified all patients based on expected prognosis of either short-term, medium-term, or long-term survival. We extend the popular 2D Gradient-weighted Class Activation Mapping (Grad-CAM), for the generation of saliency map, to 3D and combined it with the anatomical atlas, to extract brain regions, brain volume and probability map that reveal domain knowledge-based information. Results: For each OS class, a larger tumor volume was associated with a shorter OS. There were 10, 7 and 27 tumor locations in brain regions that uniquely associate with the short-term, medium-term, and long-term survival, respectively. Tumors located in the transverse temporal gyrus, fusiform, and palladium are associated with short, medium and long-term survival, respectively. The visual and textual information displayed during OS prediction highlights tumor location and the contribution of different brain regions to the prediction of OS. This algorithm design feature assists the physician in analyzing and understanding different model prediction stages. Conclusions: Domain knowledge-based information extracted from the saliency map can enhance the interpretability of deep learning models. Our findings show that tumors overlapping eloquent brain regions are associated with short patient survival.

Interpretable Machine learning model to predict survival days of malignant brain tumor patients

A Comparison of Machine Learning Models for Survival Prediction of Patients with Glioma Using Radiomic Features from MRI Scans

Reproducible and Interpretable Machine Learning-Based Radiomic Analysis for Overall Survival Prediction in Glioblastoma Multiforme

Overall Survival Prediction for Gliomas Using a Novel Compound Approach.

Optimizing Prediction of MGMT Promoter Methylation from MRI Scans using Adversarial Learning

Optimizing Glioblastoma, IDH-wildtype Treatment Outcomes : A Radiomics and Support Vector Machine -Based Approach to Overall Survival Estimation

An Interpretable Web-based Glioblastoma Multiforme Prognosis Prediction Tool using Random Forest Model

Dynamic architecture based deep learning approach for glioblastoma brain tumor survival prediction

Interpreting deep learning models for glioma survival classification using visualization and textual explanations

Automated Neural Network-based Survival Prediction of Glioblastoma Patients Using Pre-operative MRI and Clinical Data

Glioma Prognosis: Segmentation of the Tumor and Survival Prediction using Shape, Geometric and Clinical Information

Overall Survival Prediction Using Conventional MRI Features.

Estimating Progression-Free Survival in Patients with Primary High-Grade Glioma Using Machine Learning

Bios-06. Machine Learning Model Independently Identifies Clinical Features Associated With Wild-Type Glioblastoma Versus Mutant Grade 4 Astrocytoma

Predicting Overall Survival Time in Glioblastoma Patients Using Gradient Boosting Machines Algorithm and Recursive Feature Elimination Technique

Predicting Overall Survival of Glioblastoma Patients Using Deep Learning Classification Based on MRIs

A Texture Feature Ranking Model for Predicting Survival Time of Brain Tumor Patients

A neuro evolutionary algorithm for patient calibrated prediction of survival in Glioblastoma patients

Overall Survival Predictions of GBM Patients Using Radiomics: An Explainable AI Approach Using SHAP

Ensemble Learning for Glioma Patients Overall Survival Prediction Using Pre-Operative MRIs

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning