Abstract:Explainability is crucial for the application of black-box Graph Neural Networks (GNNs) in critical fields such as healthcare, finance, cybersecurity, and more. Various feature attribution methods, especially the perturbation-based methods, have been proposed to indicate how much each node/edge contributes to the model predictions. However, these methods fail to generate connected explanatory subgraphs that consider the causal interaction between edges within different coalition scales, which will result in unfaithful explanations. In our study, we propose GISExplainer, a novel game-theoretic interaction based explanation method that uncovers what the underlying GNNs have learned for node classification by discovering human-interpretable causal explanatory subgraphs. First, GISExplainer defines a causal attribution mechanism that considers the game-theoretic interaction of multi-granularity coalitions in candidate explanatory subgraph to quantify the causal effect of an edge on the prediction. Second, GISExplainer assumes that the coalitions with negative effects on the predictions are also significant for model interpretation, and the contribution of the computation graph stems from the combined influence of both positive and negative interactions within the coalitions. Then, GISExplainer regards the explanation task as a sequential decision process, in which a salient edges is successively selected and connected to the previously selected subgraph based on its causal effect to form an explanatory subgraph, ultimately striving for better explanations. Additionally, an efficiency optimization scheme is proposed for the causal attribution mechanism through coalition sampling. Extensive experiments demonstrate that GISExplainer achieves better performance than state-of-the-art approaches w.r.t. two quantitative metrics: Fidelity and Sparsity.

Explaining Graph Neural Networks via Structure-aware Interaction Index

On Explainability of Graph Neural Networks Via Subgraph Explorations.

GraphSVX: Shapley Value Explanations for Graph Neural Networks

GNNExplainer: Generating Explanations for Graph Neural Networks

Higher Order Structures For Graph Explanations

GISExplainer: On Explainability of Graph Neural Networks via Game-theoretic Interaction Subgraphs

MAGE: Model-Level Graph Neural Networks Explanations via Motif-based Graph Generation

A Survey on Explainability of Graph Neural Networks

GOAt: Explaining Graph Neural Networks via Graph Output Attribution

Structural Explanations for Graph Neural Networks using HSIC

GNNShap: Scalable and Accurate GNN Explanation using Shapley Values

Cooperative Explanations of Graph Neural Networks.

Towards Faithful and Consistent Explanations for Graph Neural Networks

Explainability in Graph Neural Networks: An Experimental Survey

Explaining Hypergraph Neural Networks: From Local Explanations to Global Concepts

GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networks

GraphXAIN: Narratives to Explain Graph Neural Networks

KnowGNN: a knowledge-aware and structure-sensitive model-level explainer for graph neural networks

Rethinking Explaining Graph Neural Networks via Non-parametric Subgraph Matching

Explainability in Graph Neural Networks: A Taxonomic Survey