Abstract:A key challenge for decision makers when incorporating black box machine learned models into practice is being able to understand the predictions provided by these models. One set of methods proposed to address this challenge is that of training surrogate explainer models which approximate how the more complex model is computing its predictions. Explainer methods are generally classified as either local or global explainers depending on what portion of the data space they are purported to explain. The improved coverage of global explainers usually comes at the expense of explainer fidelity (i.e., how well the explainer's predictions match that of the black box model). One way of trading off the advantages of both approaches is to aggregate several local explainers into a single explainer model with improved coverage. However, the problem of aggregating these local explainers is computationally challenging, and existing methods only use heuristics to form these aggregations. In this paper, we propose a local explainer aggregation method which selects local explainers using non-convex optimization. In contrast to other heuristic methods, we use an integer optimization framework to combine local explainers into a near-global aggregate explainer. Our framework allows a decision-maker to directly tradeoff coverage and fidelity of the resulting aggregation through the parameters of the optimization problem. We also propose a novel local explainer algorithm based on information filtering. We evaluate our algorithmic framework on two healthcare datasets: the Parkinson's Progression Marker Initiative (PPMI) data set and a geriatric mobility dataset from the UCI machine learning repository. Our choice of these healthcare-related datasets is motivated by the anticipated need for explainable precision medicine. We find that our method outperforms existing local explainer aggregation methods in terms of both fidelity and coverage of classification. It also improves on fidelity over existing global explainer methods, particularly in multi-class settings, where state-of-the-art methods achieve 70% and ours achieves 90%.

A universal procedure for aggregating estimators

A general procedure to combine estimators

An Iterative Scheme for Leverage-based Approximate Aggregation.

Local Risk Bounds for Statistical Aggregation

A Method with Feedback for Aggregation of Group Incomplete Pair-Wise Comparisons

Aggregated Estimating Equation Estimation

A naive aggregation algorithm for improving generalization in a class of learning problems

Conditional Tail-Related Risk Estimation Using Composite Asymmetric Least Squares and Empirical Likelihood

Model aggregation: minimizing empirical variance outperforms minimizing empirical error

An Axiomatic Approach to Loss Aggregation and an Adapted Aggregating Algorithm

Leveraging Discarded Samples for Tighter Estimation of Multiple-Set Aggregates

Anytime-Valid Generalized Universal Inference on Risk Minimizers

Element Aggregation for Estimation of High-Dimensional Covariance Matrices

UTOPIA: Universally Trainable Optimal Prediction Intervals Aggregation

Comparing Efficiency of Expert Data Aggregation Methods

Algorithmic Robust Forecast Aggregation

Robust risk aggregation with neural networks

Assessing solution quality in risk-averse stochastic programs

Risk aggregation considering probabilistic and consequential interactions: A general formulation with computational cost handling

Risk measurement of aggregation approaches in multiple attribute decision making under uncertain information

Optimal Local Explainer Aggregation for Interpretable Prediction