Abstract:In many industrial applications, it is common that the graph embeddings generated from training GNNs are used in an ensemble model where the embeddings are combined with other tabular features (e.g., original node or edge features) in a downstream ML task. The tabular features may even arise naturally if, e.g., one tries to build a graph such that some of the node or edge features are stored in a tabular format. Here we address the problem of explaining the output of such ensemble models for which the input features consist of learned neural graph embeddings combined with additional tabular features. We propose MBExplainer, a model-agnostic explanation approach for downstream models with augmented graph embeddings. MBExplainer returns a human-legible triple as an explanation for an instance prediction of the whole pipeline consisting of three components: a subgraph with the highest importance, the topmost important nodal features, and the topmost important augmented downstream features. A game-theoretic formulation is used to take the contributions of each component and their interactions into account by assigning three Shapley values corresponding to their own specific games. Finding the explanation requires an efficient search through the corresponding local search spaces corresponding to each component. MBExplainer applies a novel multilevel search algorithm that enables simultaneous pruning of local search spaces in a computationally tractable way. In particular, three interweaved Monte Carlo Tree Search are utilized to iteratively prune the local search spaces. MBExplainer also includes a global search algorithm that uses contextual bandits to efficiently allocate pruning budget among the local search spaces. We show the effectiveness of MBExplainer by presenting a set of comprehensive numerical examples on multiple public graph datasets for both node and graph classification tasks.

Approximation of group explainers with coalition structure using Monte Carlo sampling on the product space of coalitions and features

Stability theory of game-theoretic group feature explanations for machine learning models

Coalitional Strategies for Efficient Individual Prediction Explanation

Approximating the Core via Iterative Coalition Sampling

Distributed Multi-Coalition Games with General Linear Systems over Markovian Switching Networks

The explanation game: a formal framework for interpretable machine learning

Probably approximately correct stability of allocations in uncertain coalitional games with private sampling

Explainable Clustering via Exemplars: Complexity and Efficient Approximation Algorithms

MBExplainer: Multilevel bandit-based explanations for downstream models with augmented graph embeddings

Shapley Values for Explaining the Black Box Nature of Machine Learning Model Clustering

Approximations of solution concepts of cooperative games

Refined Sample Complexity for Markov Games with Independent Linear Function Approximation

Explaining Probabilistic Models with Distributional Values

Explaining Decisions of Agents in Mixed-Motive Games

Reducing Optimism Bias in Incomplete Cooperative Games

Constraint-Driven Explanations for Black-Box ML Models

Posterior Sampling for Competitive RL: Function Approximation and Partial Observation

Efficient and Accurate Explanation Estimation with Distribution Compression

A Multilinear Sampling Algorithm to Estimate Shapley Values

Monte Carlo Techniques for Approximating the Myerson Value -- Theoretical and Empirical Analysis