Abstract:The rationale behind a deep learning model's output is often difficult to understand by humans. EXplainable AI (XAI) aims at solving this by developing methods that improve interpretability and explainability of machine learning models. Reliable evaluation metrics are needed to assess and compare different XAI methods. We propose a novel evaluation approach for benchmarking state-of-the-art XAI attribution methods. Our proposal consists of a synthetic classification model accompanied by its derived ground truth explanations allowing high precision representation of input nodes contributions. We also propose new high-fidelity metrics to quantify the difference between explanations of the investigated XAI method and those derived from the synthetic model. Our metrics allow assessment of explanations in terms of precision and recall separately. Also, we propose metrics to independently evaluate negative or positive contributions of inputs. Our proposal provides deeper insights into XAI methods output. We investigate our proposal by constructing a synthetic convolutional image classification model and benchmarking several widely used XAI attribution methods using our evaluation approach. We compare our results with established prior XAI evaluation metrics. By deriving the ground truth directly from the constructed model in our method, we ensure the absence of bias, e.g., subjective either based on the training set. Our experimental results provide novel insights into the performance of Guided-Backprop and Smoothgrad XAI methods that are widely in use. Both have good precision and recall scores among positively contributing pixels (0.7, 0.76 and 0.7, 0.77, respectively), but poor precision scores among negatively contributing pixels (0.44, 0.61 and 0.47, 0.75, resp.). The recall scores in the latter case remain close. We show that our metrics are among the fastest in terms of execution time.

Efficient Explanations from Empirical Explainers

Selective Explanations

T-Explainer: A Model-Agnostic Explainability Framework Based on Gradients

Provably Better Explanations with Optimized Aggregation of Feature Attributions

How Well Do Feature-Additive Explainers Explain Feature-Additive Predictors?

Solving the enigma: Deriving optimal explanations of deep networks

Disentangled Explanations of Neural Network Predictions by Finding Relevant Subspaces

From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation

Altruist: Argumentative Explanations through Local Interpretations of Predictive Models

When Stability meets Sufficiency: Informative Explanations that do not Overwhelm

Explaining Explanations in AI

Can I Trust the Explainer? Verifying Post-hoc Explanatory Methods

Fast Explainability via Feasible Concept Sets Generator

Precise Benchmarking of Explainable AI Attribution Methods

Unifying Attribution-Based Explanations Using Functional Decomposition

Interactive dense pixel visualizations for time series and model attribution explanations

Efficient Contrastive Explanations on Demand

Efficient and Accurate Explanation Estimation with Distribution Compression

An Empirical Comparison of Interpretable Models to Post-Hoc Explanations

Feature construction using explanations of individual predictions

Learning Model Agnostic Explanations via Constraint Programming