Abstract:There is an emerging interest in generating robust counterfactual explanations that would remain valid if the model is updated or changed even slightly. Towards finding robust counterfactuals, existing literature often assumes that the original model $m$ and the new model $M$ are bounded in the parameter space, i.e., $\|\text{Params}(M){-}\text{Params}(m)\|{<}\Delta$. However, models can often change significantly in the parameter space with little to no change in their predictions or accuracy on the given dataset. In this work, we introduce a mathematical abstraction termed $\textit{naturally-occurring}$ model change, which allows for arbitrary changes in the parameter space such that the change in predictions on points that lie on the data manifold is limited. Next, we propose a measure -- that we call $\textit{Stability}$ -- to quantify the robustness of counterfactuals to potential model changes for differentiable models, e.g., neural networks. Our main contribution is to show that counterfactuals with sufficiently high value of $\textit{Stability}$ as defined by our measure will remain valid after potential $\textit{naturally-occurring}$ model changes with high probability (leveraging concentration bounds for Lipschitz function of independent Gaussians). Since our quantification depends on the local Lipschitz constant around a data point which is not always available, we also examine practical relaxations of our proposed measure and demonstrate experimentally how they can be incorporated to find robust counterfactuals for neural networks that are close, realistic, and remain valid after potential model changes. This work also has interesting connections with model multiplicity, also known as, the Rashomon effect.

Counterfactual explanation of Bayesian model uncertainty

A Framework for Counterfactual Explanation of Predictive Uncertainty in Multimodal Models

A Trustworthy Counterfactual Explanation Method With Latent Space Smoothing

Robust Counterfactual Explanations for Neural Networks With Probabilistic Guarantees

Calibrated Explanations: with Uncertainty Information and Counterfactuals

Explainability through uncertainty: Trustworthy decision-making with neural networks

Getting a CLUE: A Method for Explaining Uncertainty Estimates

Identifying Drivers of Predictive Aleatoric Uncertainty

Generating Counterfactual Explanations with Natural Language

Understanding Softmax Confidence and Uncertainty

Estimation of Concept Explanations Should be Uncertainty Aware

Counterfactual Explanations for Clustering Models

Counterfactual Explanations for Support Vector Machine Models

Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Prediction

Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review

Viewing the process of generating counterfactuals as a source of knowledge: a new approach for explaining classifiers

Causality-based Counterfactual Explanation for Classification Models

Multi-Objective Counterfactual Explanations

Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis

Overlap Number of Balls Model-Agnostic CounterFactuals (ONB-MACF): A Data-Morphology-based Counterfactual Generation Method for Trustworthy Artificial Intelligence