Abstract:This work presents CounterNet, a novel end-to-end learning framework which integrates Machine Learning (ML) model training and the generation of corresponding counterfactual (CF) explanations into a single end-to-end pipeline. Counterfactual explanations offer a contrastive case, i.e., they attempt to find the smallest modification to the feature values of an instance that changes the prediction of the ML model on that instance to a predefined output. Prior techniques for generating CF explanations suffer from two major limitations: (i) all of them are post-hoc methods designed for use with proprietary ML models -- as a result, their procedure for generating CF explanations is uninformed by the training of the ML model, which leads to misalignment between model predictions and explanations; and (ii) most of them rely on solving separate time-intensive optimization problems to find CF explanations for each input data point (which negatively impacts their runtime). This work makes a novel departure from the prevalent post-hoc paradigm (of generating CF explanations) by presenting CounterNet, an end-to-end learning framework which integrates predictive model training and the generation of counterfactual (CF) explanations into a single pipeline. Unlike post-hoc methods, CounterNet enables the optimization of the CF explanation generation only once together with the predictive model. We adopt a block-wise coordinate descent procedure which helps in effectively training CounterNet's network. Our extensive experiments on multiple real-world datasets show that CounterNet generates high-quality predictions, and consistently achieves 100% CF validity and low proximity scores (thereby achieving a well-balanced cost-invalidity trade-off) for any new input instance, and runs 3X faster than existing state-of-the-art baselines.

CaBRNet, an open-source library for developing and evaluating Case-Based Reasoning Models

Knowledge-based XAI through CBR: There is more to explanations than models can tell

Probabilistic Case-based Reasoning for Open-World Knowledge Graph Completion

CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms

A Data-driven Explainable Case-based Reasoning Approach for Financial Risk Detection

A Case Based Reasoning Approach for Answer Reranking in Question Answering

Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches

CounterNet: End-to-End Training of Prediction Aware Counterfactual Explanations

Abstraction, Validation, and Generalization for Explainable Artificial Intelligence

Case-based Reasoning for Natural Language Queries over Knowledge Bases

CRAB: Assessing the Strength of Causal Relationships Between Real-world Events

Case-based Explainability for Random Forest: Prototypes, Critics, Counter-factuals and Semi-factuals

A Methodological Approach to Model CBR-based Systems

Deep Learning for Case-Based Reasoning Through Prototypes: A Neural Network That Explains Its Predictions

Trustworthy Conceptual Explanations for Neural Networks in Robot Decision-Making

A Theoretical Framework for AI Models Explainability with Application in Biomedicine

Benchmarking and survey of explanation methods for black box models

CERTIFAI: Counterfactual Explanations for Robustness, Transparency, Interpretability, and Fairness of Artificial Intelligence models

Neural Reasoning Networks: Efficient Interpretable Neural Networks With Automatic Textual Explanations

"Why did you do that?": Explaining black box models with Inductive Synthesis