Abstract:Background: Contemporary deep learning approaches show cutting-edge performance in a variety of complex prediction tasks. Nonetheless, the application of deep learning in healthcare remains limited since deep learning methods are often considered as non-interpretable black-box models. However, the machine learning community made recent elaborations on interpretability methods explaining data point-specific decisions of deep learning techniques. We believe that such explanations can assist the need in personalized precision medicine decisions via explaining patient-specific predictions. Methods: Layer-wise Relevance Propagation (LRP) is a technique to explain decisions of deep learning methods. It is widely used to interpret Convolutional Neural Networks (CNNs) applied on image data. Recently, CNNs started to extend towards non-Euclidean domains like graphs. Molecular networks are commonly represented as graphs detailing interactions between molecules. Gene expression data can be assigned to the vertices of these graphs. In other words, gene expression data can be structured by utilizing molecular network information as prior knowledge. Graph-CNNs can be applied to structured gene expression data, for example, to predict metastatic events in breast cancer. Therefore, there is a need for explanations showing which part of a molecular network is relevant for predicting an event, e.g., distant metastasis in cancer, for each individual patient. Results: We extended the procedure of LRP to make it available for Graph-CNN and tested its applicability on a large breast cancer dataset. We present Graph Layer-wise Relevance Propagation (GLRP) as a new method to explain the decisions made by Graph-CNNs. We demonstrate a sanity check of the developed GLRP on a hand-written digits dataset and then apply the method on gene expression data. We show that GLRP provides patient-specific molecular subnetworks that largely agree with clinical knowledge and identify common as well as novel, and potentially druggable, drivers of tumor progression. Conclusions: The developed method could be potentially highly useful on interpreting classification results in the context of different omics data and prior knowledge molecular networks on the individual patient level, as for example in precision medicine approaches or a molecular tumor board.

Regression Concept Vectors for Bidirectional Explanations in Histopathology

Concept Activation Regions: A Generalized Framework For Concept-Based Explanations

Explaining Chest X-ray Pathology Models using Textual Concepts

Looking into Concept Explanation Methods for Diabetic Retinopathy Classification

Multi-modal volumetric concept activation to explain detection and classification of metastatic prostate cancer on PSMA-PET/CT

On Interpretability of Deep Learning based Skin Lesion Classifiers using Concept Activation Vectors

Evidential Concept Embedding Models: Towards Reliable Concept Explanations for Skin Disease Diagnosis

Concept-based Explainable Malignancy Scoring on Pulmonary Nodules in CT Images

Invertible Concept-based Explanations for CNN Models with Non-negative Concept Activation Vectors

Explaining Predictions of Deep Neural Classifier via Activation Analysis

Explaining Explainability: Understanding Concept Activation Vectors

Navigating Neural Space: Revisiting Concept Activation Vectors to Overcome Directional Divergence

Explaining Deep Neural Networks for Bearing Fault Detection with Vibration Concepts

Concept-based Explanation for Fine-grained Images and Its Application in Infectious Keratitis Classification

Explaining decisions of graph convolutional neural networks: patient-specific molecular subnetworks responsible for metastasis prediction in breast cancer

Digital Histopathology with Graph Neural Networks: Concepts and Explanations for Clinicians

Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosis

LCE: A Framework for Explainability of DNNs for Ultrasound Image Based on Concept Discovery

Generating Post-Hoc Explanation from Deep Neural Networks for Multi-Modal Medical Image Analysis Tasks

Abstracting Deep Neural Networks into Concept Graphs for Concept Level Interpretability