Abstract:There is an emerging interest in generating robust counterfactual explanations that would remain valid if the model is updated or changed even slightly. Towards finding robust counterfactuals, existing literature often assumes that the original model $m$ and the new model $M$ are bounded in the parameter space, i.e., $\|\text{Params}(M){-}\text{Params}(m)\|{<}\Delta$. However, models can often change significantly in the parameter space with little to no change in their predictions or accuracy on the given dataset. In this work, we introduce a mathematical abstraction termed $\textit{naturally-occurring}$ model change, which allows for arbitrary changes in the parameter space such that the change in predictions on points that lie on the data manifold is limited. Next, we propose a measure -- that we call $\textit{Stability}$ -- to quantify the robustness of counterfactuals to potential model changes for differentiable models, e.g., neural networks. Our main contribution is to show that counterfactuals with sufficiently high value of $\textit{Stability}$ as defined by our measure will remain valid after potential $\textit{naturally-occurring}$ model changes with high probability (leveraging concentration bounds for Lipschitz function of independent Gaussians). Since our quantification depends on the local Lipschitz constant around a data point which is not always available, we also examine practical relaxations of our proposed measure and demonstrate experimentally how they can be incorporated to find robust counterfactuals for neural networks that are close, realistic, and remain valid after potential model changes. This work also has interesting connections with model multiplicity, also known as, the Rashomon effect.

A Simple Proof of Posterior Robustness

Posterior Robustness with Milder Conditions: Contamination Models Revisited

Conditional Generative Models are Provably Robust: Pointwise Guarantees for Bayesian Inverse Problems

On the robustness of posterior means

On the Existence of the Adversarial Bayes Classifier (Extended Version)

Optimal Robustness Results for Some Bayesian Procedures and the Relationship to Prior-Data Conflict

Bayesian Robustness to Outliers in Linear Regression and Ratio Estimation

Robustness of Neural Networks: A Probabilistic and Practical Approach

Distributional Robustness Bounds Generalization Errors

Robust Counterfactual Explanations for Neural Networks With Probabilistic Guarantees

A New Statistical Approach for the Analysis of Uncertain Systems

Generalized Median of Means Principle for Bayesian Inference

Covariances, Robustness, and Variational Bayes

Adversarial robustness of amortized Bayesian inference

On robust fundamental theorems of asset pricing in discrete time

A Statistical Theory for the Analysis of Uncertain Systems

Robust Inference and Model Criticism Using Bagged Posteriors

How Does Bayes Error Limit Probabilistic Robust Accuracy

Reproducible Parameter Inference Using Bagged Posteriors

Posterior risk of modular and semi-modular Bayesian inference

Probabilistic Robustness Analysis—Risks, Complexity, and Algorithms