Abstract:We developed a novel machine learning (ML) algorithm with the goal of producing transparent models (i.e., understandable by humans) while also flexibly accounting for nonlinearity and interactions. Our method is based on ranked sparsity, and it allows for flexibility and user control in varying the shade of the opacity of black box machine learning methods. The main tenet of ranked sparsity is that an algorithm should be more skeptical of higher-order polynomials and interactions a priori compared to main effects, and hence, the inclusion of these more complex terms should require a higher level of evidence. In this work, we put our new ranked sparsity algorithm (as implemented in the open source R package, sparseR) to the test in a predictive model "bakeoff" (i.e., a benchmarking study of ML algorithms applied "out of the box", that is, with no special tuning). Algorithms were trained on a large set of simulated and real-world data sets from the Penn Machine Learning Benchmarks database, addressing both regression and binary classification problems. We evaluated the extent to which our human-centered algorithm can attain predictive accuracy that rivals popular black box approaches such as neural networks, random forests, and support vector machines, while also producing more interpretable models. Using out-of-bag error as a meta-outcome, we describe the properties of data sets in which human-centered approaches can perform as well as or better than black box approaches. We found that interpretable approaches predicted optimally or within 5% of the optimal method in most real-world data sets. We provide a more in-depth comparison of the performances of random forests to interpretable methods for several case studies, including exemplars in which algorithms performed similarly, and several cases when interpretable methods underperformed. This work provides a strong rationale for including human-centered transparent algorithms such as ours in predictive modeling applications.

Predicting the Association Between Fine-Grained Attributes and Black-Boxed Perceptual Performance

Human Visual Perception Based Image Quality Assessment for Video Prediction

Global-Mapping-Consistency-Constrained Visual-Semantic Embedding for Interpreting Autonomous Perception Models

Explaining Black Box Predictions and Unveiling Data Artifacts through Influence Functions

Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models

Neural Prediction Errors Enable Analogical Visual Reasoning in Human Standard Intelligence Tests.

A novel interaction-based methodology towards explainable AI with better understanding of Pneumonia Chest X-ray Images

Representing visual classification as a linear combination of words

Joint Learning Of Semantic And Latent Attributes

Learning Predictable And Discriminative Attributes For Visual Recognition

Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing

Learning Concise and Descriptive Attributes for Visual Recognition

A Self-Explanatory Method for the Black Box Problem on Discrimination Part of CNN

Visual correspondence-based explanations improve AI robustness and human-AI team accuracy

Explainable AI improves task performance in human-AI collaboration

Robust Attribute-Based Visual Recognition Using Discriminative Latent Representation.

Learning Subjective Attributes of Images from Auxiliary Sources

Can a Transparent Machine Learning Algorithm Predict Better than Its Black Box Counterparts? A Benchmarking Study Using 110 Data Sets

Precise Benchmarking of Explainable AI Attribution Methods

Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answering

Characterizing Disparity Between Edge Models and High-Accuracy Base Models for Vision Tasks