Abstract:We consider a global representation of a regression or classification function by decomposing it into the sum of main and interaction components of arbitrary order. We propose a new identification constraint that allows for the extraction of interventional SHAP values and partial dependence plots, thereby unifying local and global explanations. With our proposed identification, a feature's partial dependence plot corresponds to the main effect term plus the intercept. The interventional SHAP value of feature $k$ is a weighted sum of the main component and all interaction components that include $k$, with the weights given by the reciprocal of the component's dimension. This brings a new perspective to local explanations such as SHAP values which were previously motivated by game theory only. We show that the decomposition can be used to reduce direct and indirect bias by removing all components that include a protected feature. Lastly, we motivate a new measure of feature importance. In principle, our proposed functional decomposition can be applied to any machine learning model, but exact calculation is only feasible for low-dimensional structures or ensembles of those. We provide an algorithm and efficient implementation for gradient-boosted trees (xgboost) and random planted forest. Conducted experiments suggest that our method provides meaningful explanations and reveals interactions of higher orders. The proposed methods are implemented in an R package, available at \url{<a class="link-external link-https" href="https://github.com/PlantedML/glex" rel="external noopener nofollow">this https URL</a>}.

Feature Synergy, Redundancy, and Independence in Global Model Explanations using SHAP Vector Decomposition

Explaining the Model and Feature Dependencies by Decomposition of the Shapley Value

Succint Interaction-Aware Explanations

Unifying local and global model explanations by functional decomposition of low dimensional structures

Relative Synergy Coefficient: A Novel Way to Detect Variable Interaction in Large Dataset

Manifold-based Shapley explanations for high dimensional correlated features

Ensembles of Random SHAPs

PriSHAP: Prior-guided Shapley Value Explanations for Correlated Features

Counterfactual Shapley Additive Explanations

Disentangling Interactions and Dependencies in Feature Attribution

Unified Explanations in Machine Learning Models: A Perturbation Approach

Generating Counterfactual and Contrastive Explanations using SHAP

TsSHAP: Robust model agnostic feature-based explainability for time series forecasting

Local Interpretable Model Agnostic Shap Explanations for machine learning models

Instance-wise or Class-wise? A Tale of Neighbor Shapley for Concept-based Explanation

L-shapley and c-shapley: Efficient model interpretation for structured data

RankingSHAP -- Listwise Feature Attribution Explanations for Ranking Models

Using Shapley Values and Variational Autoencoders to Explain Predictive Models with Dependent Mixed Features

Explaining the data or explaining a model? Shapley values that uncover non-linear dependencies

Interpretability Latent Space Method: Exploiting Shapley Representation to Explain Latent Space

Shapley Value: from Cooperative Game to Explainable Artificial Intelligence