Abstract:Background: Saliency-based algorithms are able to explain the relationship between input image pixels and deep-learning model predictions. However, it may be difficult to assess the clinical value of the most important image features and the model predictions derived from the raw saliency map. This study proposes to enhance the interpretability of saliency-based deep learning model for survival classification of patients with gliomas, by extracting domain knowledge-based information from the raw saliency maps. Materials and methods: Our study includes presurgical T1-weighted (pre- and post-contrast), T2-weighted and T2-FLAIR MRIs of 147 glioma patients from the BraTs 2020 challenge dataset aligned to the SRI 24 anatomical atlas. Each image exam includes a segmentation mask and the information of overall survival (OS) from time of diagnosis (in days). This dataset was divided into training ([Formula: see text]) and validation ([Formula: see text]) datasets. The extent of surgical resection for all patients was gross total resection. We categorized the data into 42 short (mean [Formula: see text] days), 30 medium ([Formula: see text] days), and 46 long ([Formula: see text] days) survivors. A 3D convolutional neural network (CNN) trained on brain tumour MRI volumes classified all patients based on expected prognosis of either short-term, medium-term, or long-term survival. We extend the popular 2D Gradient-weighted Class Activation Mapping (Grad-CAM), for the generation of saliency map, to 3D and combined it with the anatomical atlas, to extract brain regions, brain volume and probability map that reveal domain knowledge-based information. Results: For each OS class, a larger tumor volume was associated with a shorter OS. There were 10, 7 and 27 tumor locations in brain regions that uniquely associate with the short-term, medium-term, and long-term survival, respectively. Tumors located in the transverse temporal gyrus, fusiform, and palladium are associated with short, medium and long-term survival, respectively. The visual and textual information displayed during OS prediction highlights tumor location and the contribution of different brain regions to the prediction of OS. This algorithm design feature assists the physician in analyzing and understanding different model prediction stages. Conclusions: Domain knowledge-based information extracted from the saliency map can enhance the interpretability of deep learning models. Our findings show that tumors overlapping eloquent brain regions are associated with short patient survival.

Evaluating the Clinical Utility of Artificial Intelligence Assistance and its Explanation on Glioma Grading Task

Evaluating the clinical utility of artificial intelligence assistance and its explanation on the glioma grading task

Empowering Glioma Prognosis With Transparent Machine Learning and Interpretative Insights Using Explainable AI

Artificial intelligence in glioma imaging: challenges and advances

Developing an Artificial Intelligence Model for Tumor Grading and Classification, Based on MRI Sequences of Human Brain Gliomas

Explainable AI Enhances Glaucoma Referrals, Yet the Human-AI Team Still Falls Short of the AI Alone

Artificial intelligence in neuro-oncology: advances and challenges in brain tumor diagnosis, prognosis, and precision treatment

Interactive Explainable Deep Learning Model Informs Prostate Cancer Diagnosis at MRI

Can artificial intelligence overtake human intelligence on the bumpy road towards glioma therapy?

Artificial Intelligence Imaging for Predicting High-risk Molecular Markers of Gliomas

Applications of artificial intelligence in the analysis of histopathology images of gliomas: a review

An XAI-enhanced efficientNetB0 framework for precision brain tumor detection in MRI imaging

Artificial Intelligence Applications in Pediatric Brain Tumor Imaging: A Systematic Review

Improving a neural network model by explanation-guided training for glioma classification based on MRI data

Artificial intelligence and advanced MRI techniques: A comprehensive analysis of diffuse gliomas

A new xAI framework with feature explainability for tumors decision-making in Ultrasound data: comparing with Grad-CAM

Artificial intelligence assistance significantly improves Gleason grading of prostate biopsies by pathologists

Augmented surgical decision-making for glioblastoma: integrating AI tools into education and practice

Doctor's Dilemma: Evaluating an Explainable Subtractive Spatial Lightweight Convolutional Neural Network for Brain Tumor Diagnosis

Interpreting deep learning models for glioma survival classification using visualization and textual explanations

Predictive and Explainable Artificial Intelligence for Neuroimaging Applications