Abstract:A key challenge for decision makers when incorporating black box machine learned models into practice is being able to understand the predictions provided by these models. One set of methods proposed to address this challenge is that of training surrogate explainer models which approximate how the more complex model is computing its predictions. Explainer methods are generally classified as either local or global explainers depending on what portion of the data space they are purported to explain. The improved coverage of global explainers usually comes at the expense of explainer fidelity (i.e., how well the explainer's predictions match that of the black box model). One way of trading off the advantages of both approaches is to aggregate several local explainers into a single explainer model with improved coverage. However, the problem of aggregating these local explainers is computationally challenging, and existing methods only use heuristics to form these aggregations. In this paper, we propose a local explainer aggregation method which selects local explainers using non-convex optimization. In contrast to other heuristic methods, we use an integer optimization framework to combine local explainers into a near-global aggregate explainer. Our framework allows a decision-maker to directly tradeoff coverage and fidelity of the resulting aggregation through the parameters of the optimization problem. We also propose a novel local explainer algorithm based on information filtering. We evaluate our algorithmic framework on two healthcare datasets: the Parkinson's Progression Marker Initiative (PPMI) data set and a geriatric mobility dataset from the UCI machine learning repository. Our choice of these healthcare-related datasets is motivated by the anticipated need for explainable precision medicine. We find that our method outperforms existing local explainer aggregation methods in terms of both fidelity and coverage of classification. It also improves on fidelity over existing global explainer methods, particularly in multi-class settings, where state-of-the-art methods achieve 70% and ours achieves 90%.

Observation-specific explanations through scattered data approximation

LP-Explain: Local Pictorial Explanation for Outliers.

Selective Explanations

Score-Based Explanations in Data Management and Machine Learning

Local Rule-Based Explanations of Black Box Decision Systems

Benchmarking and survey of explanation methods for black box models

Sparse and Faithful Explanations Without Sparse Models

Enhanced Local Explainability and Trust Scores with Random Forest Proximities

Provably Better Explanations with Optimized Aggregation of Feature Attributions

RbX: Region-based explanations of prediction models

Evaluating Local Explanations using White-box Models

Estimation of Concept Explanations Should be Uncertainty Aware

Model Agnostic Multilevel Explanations

Optimal Local Explainer Aggregation for Interpretable Prediction

Global-to-Local Support Spectrums for Language Model Explainability

Improving the Evaluation and Actionability of Explanation Methods for Multivariate Time Series Classification

Evaluating and Aggregating Feature-based Model Explanations

On Predictive Explanation of Data Anomalies

Explanations of Black-Box Models based on Directional Feature Interactions

Succint Interaction-Aware Explanations

Ensembles of Random SHAPs