Abstract:There is an emerging interest in generating robust counterfactual explanations that would remain valid if the model is updated or changed even slightly. Towards finding robust counterfactuals, existing literature often assumes that the original model $m$ and the new model $M$ are bounded in the parameter space, i.e., $\|\text{Params}(M){-}\text{Params}(m)\|{<}\Delta$. However, models can often change significantly in the parameter space with little to no change in their predictions or accuracy on the given dataset. In this work, we introduce a mathematical abstraction termed $\textit{naturally-occurring}$ model change, which allows for arbitrary changes in the parameter space such that the change in predictions on points that lie on the data manifold is limited. Next, we propose a measure -- that we call $\textit{Stability}$ -- to quantify the robustness of counterfactuals to potential model changes for differentiable models, e.g., neural networks. Our main contribution is to show that counterfactuals with sufficiently high value of $\textit{Stability}$ as defined by our measure will remain valid after potential $\textit{naturally-occurring}$ model changes with high probability (leveraging concentration bounds for Lipschitz function of independent Gaussians). Since our quantification depends on the local Lipschitz constant around a data point which is not always available, we also examine practical relaxations of our proposed measure and demonstrate experimentally how they can be incorporated to find robust counterfactuals for neural networks that are close, realistic, and remain valid after potential model changes. This work also has interesting connections with model multiplicity, also known as, the Rashomon effect.

δ-CLUE: Diverse Sets of Explanations for Uncertainty Estimates

Diverse, Global and Amortised Counterfactual Explanations for Uncertainty Estimates

Getting a CLUE: A Method for Explaining Uncertainty Estimates

QUCE: The Minimisation and Quantification of Path-Based Uncertainty for Generative Counterfactual Explanations

Ensured: Explanations for Decreasing the Epistemic Uncertainty in Predictions

CLUE: Concept-Level Uncertainty Estimation for Large Language Models

Explaining Machine Learning Classifiers through Diverse Counterfactual Explanations

Explaining Predictive Uncertainty by Exposing Second-Order Effects

Explainability through uncertainty: Trustworthy decision-making with neural networks

Identifying Drivers of Predictive Aleatoric Uncertainty

Robust Counterfactual Explanations for Neural Networks With Probabilistic Guarantees

Cycles of Thought: Measuring LLM Confidence through Stable Explanations

A Framework for Counterfactual Explanation of Predictive Uncertainty in Multimodal Models

Estimation of Concept Explanations Should be Uncertainty Aware

Counterfactual Explanations with Probabilistic Guarantees on their Robustness to Model Change

Positive and Negative Explanations of Uncertain Reasoning in the Framework of Possibility Theory

Interval Abstractions for Robust Counterfactual Explanations

Boundary-Aware Uncertainty for Feature Attribution Explainers

Constraint-Driven Explanations for Black-Box ML Models

Trust Regions for Explanations via Black-Box Probabilistic Certification

Calibrated Explanations: with Uncertainty Information and Counterfactuals