Abstract:Graph Neural Networks (GNNs) are neural models that leverage the dependency structure in graphical data via message passing among the graph nodes. GNNs have emerged as pivotal architectures in analyzing graph-structured data, and their expansive application in sensitive domains requires a comprehensive understanding of their decision-making processes -- necessitating a framework for GNN explainability. An explanation function for GNNs takes a pre-trained GNN along with a graph as input, to produce a `sufficient statistic' subgraph with respect to the graph label. A main challenge in studying GNN explainability is to provide fidelity measures that evaluate the performance of these explanation functions. This paper studies this foundational challenge, spotlighting the inherent limitations of prevailing fidelity metrics, including $Fid_+$, $Fid_-$, and $Fid_\Delta$. Specifically, a formal, information-theoretic definition of explainability is introduced and it is shown that existing metrics often fail to align with this definition across various statistical scenarios. The reason is due to potential distribution shifts when subgraphs are removed in computing these fidelity measures. Subsequently, a robust class of fidelity measures are introduced, and it is shown analytically that they are resilient to distribution shift issues and are applicable in a wide range of scenarios. Extensive empirical analysis on both synthetic and real datasets are provided to illustrate that the proposed metrics are more coherent with gold standard metrics. The source code is available at <a class="link-external link-https" href="https://trustai4s-lab.github.io/fidelity" rel="external noopener nofollow">this https URL</a>.

Reliability Evaluation of Park-level Electricity-Hydrogen Systems Using Explainable Graph Neural Network

Graph neural networks for power grid operational risk assessment under evolving grid topology

Data-driven Efficient Reliability Evaluation of Power Systems with Wind Penetration: an Integrated GANs and CE Method

GraphFramEx: Towards Systematic Evaluation of Explainability Methods for Graph Neural Networks

Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networks

Explainability in Graph Neural Networks: An Experimental Survey

Power System Fault Diagnosis and Prediction System Based on Graph Neural Network

An interpretable graph convolutional neural network based fault diagnosis method for building energy systems

Power grid operational risk assessment using graph neural network surrogates

Graph Isomorphic Networks for Assessing Reliability of the Medium-Voltage Grid

Confidence-Aware Graph Neural Networks for Learning Reliability Assessment Commitments

Towards Fine-Grained Explainability for Heterogeneous Graph Neural Network

Explainability in Graph Neural Networks: A Taxonomic Survey

A hybrid model of convolutional neural network and an extreme gradient boosting for reliability evaluation in composite power systems integrated with renewable energy resources

Machine-learning-based Reliability Evaluation Framework for Power Distribution Networks

A Survey on Explainability of Graph Neural Networks

A Fast Reliability Evaluation Strategy for Power Systems under High Proportional Renewable Energy—A Hybrid Data-Driven Method

Automated Detection and Diagnosis of Leak Fault Considering Volatility by Graph Deep Probability Learning

Robust explanations for graph neural network with neuron explanation component

SafePowerGraph: Safety-aware Evaluation of Graph Neural Networks for Transmission Power Grids