Abstract:We report on the design and implementation of a general framework for interactively explaining the outputs of modern data-parallel computations, including iterative data analytics. To produce explanations, existing works adopt a naive backward tracing approach which runs into known issues; naive backward tracing may identify: (i) too much information that is difficult to process, and (ii) not enough information to reproduce the output, which hinders the logical debugging of the program. The contribution of this work is twofold. First, we provide methods to effectively reduce the size of explanations based on the first occurrence of a record in an iterative computation. Second, we provide a general method for identifying explanations that are sufficient to reproduce the target output in arbitrary computations -- a problem for which no viable solution existed until now. We implement our approach on differential dataflow , a modern high-throughput, low-latency dataflow platform. We add a small (but extensible) set of rules to explain each of its data-parallel operators, and we implement these rules as differential dataflow operators themselves. This choice allows our implementation to inherit the performance characteristics of differential dataflow, and results in a system that efficiently computes and updates explanatory inputs even as the inputs of the reference computation change. We evaluate our system with various analytic tasks on real datasets, and we show that it produces concise explanations in tens of milliseconds, while remaining faster -- up to two orders of magnitude -- than even the best implementations that do not support explanations.

Explanations for combinatorial optimization problems

Optimal Counterfactual Explanations in Tree Ensembles

Counterfactual Explanations for Linear Optimization

Directly Optimizing Explanations for Desired Properties

A Framework for Data-Driven Explainability in Mathematical Optimization

Convex optimization for actionable \& plausible counterfactual explanations

Explaining outputs in modern data analytics

Multi-Objective Counterfactual Explanations

Explanation as a process: user-centric construction of multi-level and multi-modal explanations

Computing Rule-Based Explanations by Leveraging Counterfactuals

One Explanation to Rule them All -- Ensemble Consistent Explanations

Explaining Explanations in Probabilistic Logic Programming

S-CFE: Simple Counterfactual Explanations

On the Computation of Necessary and Sufficient Explanations

Mining Potentially Explanatory Patterns via Partial Solutions

Efficiently Explaining CSPs with Unsatisfiable Subset Optimization (extended algorithms and examples)

Learning Model Agnostic Explanations via Constraint Programming

Fast Explainability via Feasible Concept Sets Generator

Constraint-Driven Explanations for Black-Box ML Models

Explaining Results of Multi-Criteria Decision Making

A multi-criteria approach for selecting an explanation from the set of counterfactuals produced by an ensemble of explainers