Abstract:Can machine learning improve human decision making? Bail decisions provide a good test case. Millions of times each year, judges make jail-or-release decisions that hinge on a prediction of what a defendant would do if released. The concreteness of the prediction task combined with the volume of data available makes this a promising machine-learning application. Yet comparing the algorithm to judges proves complicated. First, the available data are generated by prior judge decisions. We only observe crime outcomes for released defendants, not for those judges detained. This makes it hard to evaluate counterfactual decision rules based on algorithmic predictions. Second, judges may have a broader set of preferences than the variable the algorithm predicts; for instance, judges may care specifically about violent crimes or about racial inequities. We deal with these problems using different econometric strategies, such as quasi-random assignment of cases to judges. Even accounting for these concerns, our results suggest potentially large welfare gains: one policy simulation shows crime reductions up to 24.7% with no change in jailing rates, or jailing rate reductions up to 41.9% with no increase in crime rates. Moreover, all categories of crime, including violent crimes, show reductions; and these gains can be achieved while simultaneously reducing racial disparities. These results suggest that while machine learning can be valuable, realizing this value requires integrating these tools into an economic framework: being clear about the link between predictions and decisions; specifying the scope of payoff functions; and constructing unbiased decision counterfactuals. JEL Codes: C10 (Econometric and statistical methods and methodology), C55 (Large datasets: Modeling and analysis), K40 (Legal procedure, the legal system, and illegal behavior).

Using Regression Kernels to Forecast A Failure to Appear in Court

Forecasting Criminal Activity Using Machine Learning Approaches

An impact assessment of machine learning risk forecasts on parole board decisions and recidivism

HUMAN DECISIONS AND MACHINE PREDICTIONS

A Learnable Kernel Machine for Short-Term Load Forecasting

Koopman Kernel Regression

Improving Fairness in Criminal Justice Algorithmic Risk Assessments Using Conformal Prediction Sets

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Interventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment

Financial Forecasting Using Pattern Modeling and Recognition System Based on Kernel Regression

A Binary Logistic Regression Model for Support Decision Making in Criminal Justice

In Pursuit of Interpretable, Fair and Accurate Machine Learning for Criminal Recidivism Prediction

Reducing race-based bias and increasing recidivism prediction accuracy by using past criminal history details

A Comparative User Study of Human Predictions in Algorithm-Supported Recidivism Risk Assessment

Kernel machines for current status data

Deep Kernel Learning for Mortality Prediction in the Face of Temporal Shift

Can nonexperts really emulate statistical learning methods? A comment on “The accuracy, fairness, and limits of predicting recidivism”

Forecasting Crime with Deep Learning

Crime forecasting: a machine learning and computer vision approach to crime prediction and prevention

RNN-BOF: A Multivariate Global Recurrent Neural Network for Binary Outcome Forecasting of Inpatient Aggression

On Software Defect Prediction Using Machine Learning