Abstract:With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to explain models. Post hoc explanation methods explain the behaviour of complex black-box models by identifying features critical to model predictions; however, prior work has shown that these explanations may not be faithful, in that they incorrectly attribute high importance to features that are unimportant or non-discriminative for the underlying task. Inherently interpretable models, on the other hand, circumvent these issues by explicitly encoding explanations into model architecture, meaning their explanations are naturally faithful, but they often exhibit poor predictive performance due to their limited expressive power. In this work, we identify a key reason for the lack of faithfulness of feature attributions: the lack of robustness of the underlying black-box models, especially to the erasure of unimportant distractor features in the input. To address this issue, we propose Distractor Erasure Tuning (DiET), a method that adapts black-box models to be robust to distractor erasure, thus providing discriminative and faithful attributions. This strategy naturally combines the ease of use of post hoc explanations with the faithfulness of inherently interpretable models. We perform extensive experiments on semi-synthetic and real-world datasets and show that DiET produces models that (1) closely approximate the original black-box models they are intended to explain, and (2) yield explanations that match approximate ground truths available by construction. Our code is made public at <a class="link-external link-https" href="https://github.com/AI4LIFE-GROUP/DiET" rel="external noopener nofollow">this https URL</a>.

Task-Driven Causal Feature Distillation: Towards Trustworthy Risk Prediction

DCCD: Reducing Neural Network Redundancy Via Distillation

Towards Fixing Clever-Hans Predictors with Counterfactual Knowledge Distillation

Causality Refined Diagnostic Prediction

De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts

Causal Distillation for Alleviating Performance Heterogeneity in Recommender Systems

Double Confidence Calibration Focused Distillation for Task-Incremental Learning

Instance-Wise Causal Feature Selection Explainer for Rotating Machinery Fault Diagnosis

Task-Oriented Feature Distillation.

Reliable Estimation of Causal Effects Using Predictive Models

Directed Acyclic Graph Factorization Machines for CTR Prediction via Knowledge Distillation

Feature Interaction Fusion Self-Distillation Network For CTR Prediction

RedCDR: Dual Relation Distillation for Cancer Drug Response Prediction

CausalTime: Realistically Generated Time-series for Benchmarking of Causal Discovery

Causal Interventional Prediction System for Robust and Explainable Effect Forecasting

CausalConceptTS: Causal Attributions for Time Series Classification using High Fidelity Diffusion Models

DeepCausality: A general AI-powered causal inference framework for free text: A case study of LiverTox

Improving drug-target affinity prediction via feature fusion and knowledge distillation

Causal-discovery-based root-cause analysis and its application in time-series prediction error diagnosis

Discriminative Feature Attributions: Bridging Post Hoc Explainability and Inherent Interpretability

A Comprehensive and Reliable Feature Attribution Method: Double-sided Remove and Reconstruct (DoRaR)