Abstract:We are interested in developing a data-driven method to evaluate race-induced biases in law enforcement systems. While the recent works have addressed this question in the context of police-civilian interactions using police stop data, they have two key limitations. First, bias can only be properly quantified if true criminality is accounted for in addition to race, but it is absent in prior works. Second, law enforcement systems are multi-stage and hence it is important to isolate the true source of bias within the "causal chain of interactions" rather than simply focusing on the end outcome; this can help guide reforms. In this work, we address these challenges by presenting a multi-stage causal framework incorporating criminality. We provide a theoretical characterization and an associated data-driven method to evaluate (a) the presence of any form of racial bias, and (b) if so, the primary source of such a bias in terms of race and criminality. Our framework identifies three canonical scenarios with distinct characteristics: in settings like (1) airport security, the primary source of observed bias against a race is likely to be bias in law enforcement against innocents of that race; (2) AI-empowered policing, the primary source of observed bias against a race is likely to be bias in law enforcement against criminals of that race; and (3) police-civilian interaction, the primary source of observed bias against a race could be bias in law enforcement against that race or bias from the general public in reporting against the other race. Through an extensive empirical study using police-civilian interaction data and 911 call data, we find an instance of such a counter-intuitive phenomenon: in New Orleans, the observed bias is against the majority race and the likely reason for it is the over-reporting (via 911 calls) of incidents involving the minority race by the general public.

Spillover Effects of Minority Representation on Majority Bureaucrats’ Behavioral Change

A Causal Framework to Evaluate Racial Bias in Law Enforcement Systems

The role of officer race and gender in police-civilian interactions in Chicago

Do digital technologies reduce racially biased reporting? Evidence from NYPD administrative data

Managing racial diversity: The context of state legal and political cultures

Racial Profiling, Statistical Discrimination, and the Effect of a Colorblind Policy on the Crime Rate

When intragroup conflict is a good thing: team diversity and use of force by police

Racial Discrimination and Administrative Burden in Access to Public Services

Minority Threat, Worker Power, and Discriminatory Complaints: State-level Effects on Racial Income Inequality among Men

Social Media Representations of Law Enforcement within Four Diverse Chicago Neighborhoods

Associations of Racial Equity Training, Policies, and Practices With Routine Supervision Strategies in Community Corrections

Student Race, School Police, and the School-To-Prison Pipeline: Mixed Evidence of Indirect Pathways

Administrative Errors and Race: Can Technology Mitigate Inequitable Administrative Outcomes?

Understanding vehicle consent search requests through the use of the social conditioning model and illusory correlation

Smartphone Data Reveal Neighborhood-Level Racial Disparities in Police Presence

Officer characteristics and racial disparities in fatal officer-involved shootings

The Struggle Is Real: Employee Reactions to Indirect Trauma from Anti-Black Policing

Lowering the Playing Field: Discrimination through Sequential Spillover Effects

Attitudes Toward the Police: The Effects of Direct and Vicarious Experience

Heterogeneous causal effects of neighborhood policing in New York City with staggered adoption of the policy

Language from police body camera footage shows racial disparities in officer respect