Abstract:Across domains such as medicine, employment, and criminal justice, predictive models often target labels that imperfectly reflect the outcomes of interest to experts and policymakers. For example, clinical risk assessments deployed to inform physician decision-making often predict measures of healthcare utilization (e.g., costs, hospitalization) as a proxy for patient medical need. These proxies can be subject to outcome measurement error when they systematically differ from the target outcome they are intended to measure. However, prior modeling efforts to characterize and mitigate outcome measurement error overlook the fact that the decision being informed by a model often serves as a risk-mitigating intervention that impacts the target outcome of interest and its recorded proxy. Thus, in these settings, addressing measurement error requires counterfactual modeling of treatment effects on outcomes. In this work, we study intersectional threats to model reliability introduced by outcome measurement error, treatment effects, and selection bias from historical decision-making policies. We develop an unbiased risk minimization method which, given knowledge of proxy measurement error properties, corrects for the combined effects of these challenges. We also develop a method for estimating treatment-dependent measurement error parameters when these are unknown in advance. We demonstrate the utility of our approach theoretically and via experiments on real-world data from randomized controlled trials conducted in healthcare and employment domains. As importantly, we demonstrate that models correcting for outcome measurement error or treatment effects alone suffer from considerable reliability limitations. Our work underscores the importance of considering intersectional threats to model validity during the design and evaluation of predictive models for decision support.

A Characterization of Prediction Errors

Understanding Prediction Discrepancies in Machine Learning Classifiers

Accountable Error Characterization

On the Unknowable Limits to Prediction

Making Early Predictions of the Accuracy of Machine Learning Applications

Assessing the accuracy of prediction algorithms for classification: an overview

Clinical Prediction Models: Model Development

The prediction-explanation fallacy: A pervasive problem in scientific applications of machine learning

On the Efficacy of Generalization Error Prediction Scoring Functions

Identifying Prediction Mistakes in Observational Data

Errors in predictor variables

Counterfactual Prediction Under Outcome Measurement Error

Prediction in Measurement Error Models

Predictability Analysis of Regression Problems via Conditional Entropy Estimations

Predictions as statements and decisions

Explainable analytics: understanding causes, correcting errors, and achieving increasingly perfect accuracy from the nature of distinguishable patterns

A Learning Error Analysis for Structured Prediction with Approximate Inference

On Learning Errors of Structured Prediction with Approximate Inference

Evaluating Model Bias Requires Characterizing its Mistakes

Integrating Human Behavior Modeling and Data Mining Techniques to Predict Human Errors in Numerical Typing

Why is the prediction wrong? Towards underfitting case explanation via meta-classification