Abstract:We developed a novel machine learning (ML) algorithm with the goal of producing transparent models (i.e., understandable by humans) while also flexibly accounting for nonlinearity and interactions. Our method is based on ranked sparsity, and it allows for flexibility and user control in varying the shade of the opacity of black box machine learning methods. The main tenet of ranked sparsity is that an algorithm should be more skeptical of higher-order polynomials and interactions a priori compared to main effects, and hence, the inclusion of these more complex terms should require a higher level of evidence. In this work, we put our new ranked sparsity algorithm (as implemented in the open source R package, sparseR) to the test in a predictive model "bakeoff" (i.e., a benchmarking study of ML algorithms applied "out of the box", that is, with no special tuning). Algorithms were trained on a large set of simulated and real-world data sets from the Penn Machine Learning Benchmarks database, addressing both regression and binary classification problems. We evaluated the extent to which our human-centered algorithm can attain predictive accuracy that rivals popular black box approaches such as neural networks, random forests, and support vector machines, while also producing more interpretable models. Using out-of-bag error as a meta-outcome, we describe the properties of data sets in which human-centered approaches can perform as well as or better than black box approaches. We found that interpretable approaches predicted optimally or within 5% of the optimal method in most real-world data sets. We provide a more in-depth comparison of the performances of random forests to interpretable methods for several case studies, including exemplars in which algorithms performed similarly, and several cases when interpretable methods underperformed. This work provides a strong rationale for including human-centered transparent algorithms such as ours in predictive modeling applications.

Opening the Black Box: Machine Learning Interpretability and Inference Tools with an Application to Economic Forecasting

Opening the Black Box of Neural Networks: Methods for Interpreting Neural Network Models in Clinical Applications

How is Machine Learning Useful for Macroeconomic Forecasting?

Random Forests with Economic Roots: Explaining Machine Learning in Hedonic Imputation

Machine Learning for Economic Forecasting: An Application to China's GDP Growth

Conceptualization of Machine Learning in Economic Forecasting

Assessing machine learning for forecasting economic risk: Evidence from an expanded Chinese financial information set

Opening the Black Box of Financial AI with CLEAR-Trade: A CLass-Enhanced Attentive Response Approach for Explaining and Visualizing Deep Learning-Driven Stock Market Prediction

Econometrics of Machine Learning Methods in Economic Forecasting

Analyzing credit spread changes using explainable artificial intelligence

Fundamental Analysis via Machine Learning

Can a Transparent Machine Learning Algorithm Predict Better than Its Black Box Counterparts? A Benchmarking Study Using 110 Data Sets

Machine Learning: An Applied Econometric Approach

Mining Big Data Using Parsimonious Factor, Machine Learning, Variable Selection and Shrinkage Methods

Model-Agnostic Interpretation Framework in Machine Learning: A Comparative Study in NBA Sports

Beyond Econometrics: A Roadmap Towards Financial Machine Learning

Comparative Analysis of Machine Learning, Hybrid, and Deep Learning Forecasting Models Evidence from European Financial Markets and Bitcoins

Interpretable Neural Networks for Panel Data Analysis in Economics

An Introduction to Machine Learning for Panel Data

Can Machine Learning Catch Economic Recessions Using Economic and Market Sentiments?