Abstract:Importance: The lack of standards in methods to reduce bias for clinical algorithms presents various challenges in providing reliable predictions and in addressing health disparities.Objective: To evaluate approaches for reducing bias in machine learning models using a real-world clinical scenario.Design, Setting, and Participants: Health data for this cohort study were obtained from the IBM MarketScan Medicaid Database. Eligibility criteria were as follows: (1) Female individuals aged 12 to 55 years with a live birth record identified by delivery-related codes from January 1, 2014, through December 31, 2018; (2) greater than 80% enrollment through pregnancy to 60 days post partum; and (3) evidence of coverage for depression screening and mental health services. Statistical analysis was performed in 2020.Exposures: Binarized race (Black individuals and White individuals).Main Outcomes and Measures: Machine learning models (logistic regression [LR], random forest, and extreme gradient boosting) were trained for 2 binary outcomes: postpartum depression (PPD) and postpartum mental health service utilization. Risk-adjusted generalized linear models were used for each outcome to assess potential disparity in the cohort associated with binarized race (Black or White). Methods for reducing bias, including reweighing, Prejudice Remover, and removing race from the models, were examined by analyzing changes in fairness metrics compared with the base models. Baseline characteristics of female individuals at the top-predicted risk decile were compared for systematic differences. Fairness metrics of disparate impact (DI, 1 indicates fairness) and equal opportunity difference (EOD, 0 indicates fairness).Results: Among 573 634 female individuals initially examined for this study, 314 903 were White (54.9%), 217 899 were Black (38.0%), and the mean (SD) age was 26.1 (5.5) years. The risk-adjusted odds ratio comparing White participants with Black participants was 2.06 (95% CI, 2.02-2.10) for clinically recognized PPD and 1.37 (95% CI, 1.33-1.40) for postpartum mental health service utilization. Taking the LR model for PPD prediction as an example, reweighing reduced bias as measured by improved DI and EOD metrics from 0.31 and -0.19 to 0.79 and 0.02, respectively. Removing race from the models had inferior performance for reducing bias compared with the other methods (PPD: DI = 0.61; EOD = -0.05; mental health service utilization: DI = 0.63; EOD = -0.04).Conclusions and Relevance: Clinical prediction models trained on potentially biased data may produce unfair outcomes on the basis of the chosen metrics. This study's results suggest that the performance varied depending on the model, outcome label, and method for reducing bias. This approach toward evaluating algorithmic bias can be used as an example for the growing number of researchers who wish to examine and address bias in their data and models.

A Data-Centric Approach to Detecting and Mitigating Demographic Bias in Pediatric Mental Health Text: A Case Study in Anxiety Detection

Interpretable bias mitigation for textual data: Reducing gender bias in patient notes while maintaining classification performance

The Sociodemographic Biases in Machine Learning Algorithms: A Biomedical Informatics Perspective

An AI-Guided Data Centric Strategy to Detect and Mitigate Biases in Healthcare Datasets

Gender Bias When Using Artificial Intelligence to Assess Anorexia Nervosa on Social Media: Data-Driven Study

Bias Discovery in Machine Learning Models for Mental Health

A Call to Action on Assessing and Mitigating Bias in Artificial Intelligence Applications for Mental Health

Bias Reducing Multitask Learning on Mental Health Prediction

Artificial Intelligence in mental health and the biases of language based models

Can AI Help Reduce Disparities in General Medical and Mental Health Care?

Debias-CLR: A Contrastive Learning Based Debiasing Method for Algorithmic Fairness in Healthcare Applications

Examining Linguistic Differences in Electronic Health Records for Diverse Patients With Diabetes: Natural Language Processing Analysis

Sources of bias in artificial intelligence that perpetuate healthcare disparities—A global review

Conceptualizing bias in EHR data: A case study in performance disparities by demographic subgroups for a pediatric obesity incidence classifier

Comparison of Methods to Reduce Bias From Clinical Prediction Models of Postpartum Depression

In the Name of Fairness: Assessing the Bias in Clinical Record De-identification

Risk of Training Diagnostic Algorithms on Data with Demographic Bias

Unmasking Bias in AI: A Systematic Review of Bias Detection and Mitigation Strategies in Electronic Health Record-based Models

Unmasking bias in artificial intelligence: a systematic review of bias detection and mitigation strategies in electronic health record-based models

Evaluating and mitigating unfairness in multimodal remote mental health assessments

Reducing Biases towards Minoritized Populations in Medical Curricular Content via Artificial Intelligence for Fairer Health Outcomes