Abstract:The algorithmic fairness of predictive analytic tools in the public sector has increasingly become a topic of rigorous exploration. While instruments pertaining to criminal recidivism and academic admissions, for example, have garnered much attention, the predictive instruments of Child Welfare jurisdictions have received considerably less attention. This is in part because comparatively few such instruments exist and because even fewer have been scrutinized through the lens of algorithmic fairness. In this work, we seek to address both of these gaps. To this end, a novel classification algorithm for predicting reunification success within Oregon Child Welfare is presented, including all of the relevant details associated with building such an instrument. The purpose of this tool is to maximize the number of stable reunifications and identify potentially unstable reunifications which may require additional resources and scrutiny. Additionally, because the algorithmic fairness of the resulting tool, if left unaltered, is unquestionably lacking, the utilized procedure for mitigating such unfairness is presented, along with the rationale behind each difficult and unavoidable choice. This procedure, though similar to other post-processing group-specific thresholding methods, is novel in its use of a penalized optimizer and contextually requisite subsampling. These novel methodological components yield a rich and informative empirical understanding of the trade-off continuum between fairness and accuracy. As the developed procedure is generalizable across a variety of group-level definitions of algorithmic fairness, as well as across an arbitrary number of protected attribute levels and risk thresholds, the approach is broadly applicable both within and beyond Child Welfare.

Child welfare predictive risk models and legal decision making

Predictive risk modeling for child maltreatment detection and enhanced decision-making: Evidence from Danish administrative data

Predicting Successful Placements for Youth in Child Welfare with Machine Learning

Beyond Predictive Algorithms in Child Welfare

How to Train a (Bad) Algorithmic Caseworker: A Quantitative Deconstruction of Risk Assessments in Child-Welfare

Potential Biased Outcomes on Child Welfare and Racial Minorities in New Zealand using Predictive Models: An Initial Review on Mitigation Approaches

Professionals' decision-making about out-of-home placements following instances of child abuse

Flipping the Script on Criminal Justice Risk Assessment: An actuarial model for assessing the risk the federal sentencing system poses to defendants

Feedback Effects in Repeat-Use Criminal Risk Assessments

Testing a hybrid risk assessment model: Predicting CSAM offender risk from digital forensic artifacts

A Case Study on a Sustainable Framework for Ethically Aware Predictive Modeling

Interventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment

The Pursuit of Algorithmic Fairness: On "Correcting" Algorithmic Unfairness in a Child Welfare Reunification Success Classifier

A statistical framework for fair predictive algorithms

Online child pornography offender risk assessment using digital forensic artifacts: The need for a hybrid model

Algorithmic Risk Assessments Can Alter Human Decision-Making Processes in High-Stakes Government Contexts

A Comparative User Study of Human Predictions in Algorithm-Supported Recidivism Risk Assessment

In Pursuit of Interpretable, Fair and Accurate Machine Learning for Criminal Recidivism Prediction

"If it didn't happen, why would I change my decision?": How Judges Respond to Counterfactual Explanations for the Public Safety Assessment

The limited value of machine learning approach to improving predictive performance: The Ministry of Justice Case Assessment Tool.

A Data-Driven Simulation of the New York State Foster Care System