Abstract:Background: Contemporary deep learning approaches show cutting-edge performance in a variety of complex prediction tasks. Nonetheless, the application of deep learning in healthcare remains limited since deep learning methods are often considered as non-interpretable black-box models. However, the machine learning community made recent elaborations on interpretability methods explaining data point-specific decisions of deep learning techniques. We believe that such explanations can assist the need in personalized precision medicine decisions via explaining patient-specific predictions. Methods: Layer-wise Relevance Propagation (LRP) is a technique to explain decisions of deep learning methods. It is widely used to interpret Convolutional Neural Networks (CNNs) applied on image data. Recently, CNNs started to extend towards non-Euclidean domains like graphs. Molecular networks are commonly represented as graphs detailing interactions between molecules. Gene expression data can be assigned to the vertices of these graphs. In other words, gene expression data can be structured by utilizing molecular network information as prior knowledge. Graph-CNNs can be applied to structured gene expression data, for example, to predict metastatic events in breast cancer. Therefore, there is a need for explanations showing which part of a molecular network is relevant for predicting an event, e.g., distant metastasis in cancer, for each individual patient. Results: We extended the procedure of LRP to make it available for Graph-CNN and tested its applicability on a large breast cancer dataset. We present Graph Layer-wise Relevance Propagation (GLRP) as a new method to explain the decisions made by Graph-CNNs. We demonstrate a sanity check of the developed GLRP on a hand-written digits dataset and then apply the method on gene expression data. We show that GLRP provides patient-specific molecular subnetworks that largely agree with clinical knowledge and identify common as well as novel, and potentially druggable, drivers of tumor progression. Conclusions: The developed method could be potentially highly useful on interpreting classification results in the context of different omics data and prior knowledge molecular networks on the individual patient level, as for example in precision medicine approaches or a molecular tumor board.

A framework for falsifiable explanations of machine learning models with an application in computational pathology

Explainability and causability in digital pathology

Counterfactual Diffusion Models for Mechanistic Explainability of Artificial Intelligence Models in Pathology

Towards the Augmented Pathologist: Challenges of Explainable-AI in Digital Pathology

Are Explanations Helpful? A Comparative Analysis of Explainability Methods in Skin Lesion Classifiers

Aligning Human Knowledge with Visual Concepts Towards Explainable Medical Image Classification

Visual explanations for polyp detection: How medical doctors assess intrinsic versus extrinsic explanations

Interpretable Explanations of Black Boxes by Meaningful Perturbation

Enhancing Deep Learning Model Explainability in Brain Tumor Datasets using Post-Heuristic Approaches

Exemplars and Counterexemplars Explanations for Image Classifiers, Targeting Skin Lesion Labeling

Model‐agnostic explanations for survival prediction models

Improving trust and confidence in medical skin lesion diagnosis through explainable deep learning

Explainable Deep Image Classifiers for Skin Lesion Diagnosis

Explaining decisions of graph convolutional neural networks: patient-specific molecular subnetworks responsible for metastasis prediction in breast cancer

Studying Limits of Explainability by Integrated Gradients for Gene Expression Models

Coherent Concept-based Explanations in Medical Image and Its Application to Skin Lesion Diagnosis

Challenges in explaining deep learning models for data with biological variation

TACE: Tumor-Aware Counterfactual Explanations

Explainable AI for computational pathology identifies model limitations and tissue biomarkers

Methodological Explainability Evaluation of an Interpretable Deep Learning Model for Post-Hepatectomy Liver Failure Prediction Incorporating Counterfactual Explanations and Layerwise Relevance Propagation: A Prospective In Silico Trial

Pixel-Level Explanation of Multiple Instance Learning Models in Biomedical Single Cell Images