Abstract:We are interested in developing a data-driven method to evaluate race-induced biases in law enforcement systems. While the recent works have addressed this question in the context of police-civilian interactions using police stop data, they have two key limitations. First, bias can only be properly quantified if true criminality is accounted for in addition to race, but it is absent in prior works. Second, law enforcement systems are multi-stage and hence it is important to isolate the true source of bias within the "causal chain of interactions" rather than simply focusing on the end outcome; this can help guide reforms. In this work, we address these challenges by presenting a multi-stage causal framework incorporating criminality. We provide a theoretical characterization and an associated data-driven method to evaluate (a) the presence of any form of racial bias, and (b) if so, the primary source of such a bias in terms of race and criminality. Our framework identifies three canonical scenarios with distinct characteristics: in settings like (1) airport security, the primary source of observed bias against a race is likely to be bias in law enforcement against innocents of that race; (2) AI-empowered policing, the primary source of observed bias against a race is likely to be bias in law enforcement against criminals of that race; and (3) police-civilian interaction, the primary source of observed bias against a race could be bias in law enforcement against that race or bias from the general public in reporting against the other race. Through an extensive empirical study using police-civilian interaction data and 911 call data, we find an instance of such a counter-intuitive phenomenon: in New Orleans, the observed bias is against the majority race and the likely reason for it is the over-reporting (via 911 calls) of incidents involving the minority race by the general public.

Racial Disparities in the Criminal Legal System: Shadows of Doubt and Beyond

The Numbers Don’t Speak for Themselves: Racial Disparities and the Persistence of Inequality in the Criminal Justice System

Racial Sentencing Disparities and Differential Progression Through the Criminal Justice System: Evidence From Linked Federal and State Court Data

Fairness Deconstructed: A Sociotechnical View of 'Fair' Algorithms in Criminal Justice

Structurally Unjust: How Lay Beliefs about Racism Relate to Perceptions of and Responses to Racial Inequality in Criminal Justice

Perceptions of Anti-Black Bias in the Criminal Justice System Contribute to Pro-Black (Versus White) Bias in Criminal Justice Research

Judges’ Perceptions of Systemic Racism in the Criminal Justice System

Toward an understanding of structural racism: Implications for criminal justice

AI & Racial Equity: Understanding Sentiment Analysis Artificial Intelligence, Data Security, and Systemic Theory in Criminal Justice Systems

Racial Disparity in Juvenile Diversion

A Causal Framework to Evaluate Racial Bias in Law Enforcement Systems

Racial Inequality in Psychological Research: Trends of the Past and Recommendations for the Future

Blinding prosecutors to defendants’ race: A policy proposal to reduce unconscious bias in the criminal justice system

Racial Profiling, Statistical Discrimination, and the Effect of a Colorblind Policy on the Crime Rate

The Progression of Disparities within the Criminal Justice System: Differential Enforcement and Risk Assessment Instruments

How Endogenous System Bias Can Distort Decision-Making in Criminal Justice Systems

The role of perceived defendant criminality on attributions and case outcomes

A statistical framework for fair predictive algorithms

Concentrated disadvantage, racial disparities, and juvenile institutionalization within the context of attribution theory

The perfect match: Do criminal stereotypes bias forensic evidence analysis?

On Racial Disparities in Recent Fatal Police Shootings