Abstract:Problem definition: Data analytics models and machine learning algorithms are increasingly deployed to support consequential decision-making processes, from deciding which applicants will receive job offers and loans to university enrollments and medical interventions. However, recent studies show these models may unintentionally amplify human bias and yield significant unfavorable decisions to specific groups. Methodology/results: We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in the equality of opportunity criterion. We use a type-[Formula: see text] Wasserstein ambiguity set centered at the empirical distribution to represent distributional uncertainty and derive a conservative reformulation for the worst-case equal opportunity unfairness measure. We show that the model is equivalent to a mixed binary conic optimization problem, which standard off-the-shelf solvers can solve. We propose a convex, hinge-loss-based model for large problem instances whose reformulation does not incur binary variables to improve scalability. Moreover, we also consider the distributionally robust learning problem with a generic ground transportation cost to hedge against the label and sensitive attribute uncertainties. We numerically examine the performance of our proposed models on five real-world data sets related to individual analysis. Compared with the state-of-the-art methods, our proposed approaches significantly improve fairness with negligible loss of predictive accuracy in the testing data set. Managerial implications: Our paper raises awareness that bias may arise when predictive models are used in service and operations. It generally comes from human bias, for example, imbalanced data collection or low sample sizes, and is further amplified by algorithms. Incorporating fairness constraints and the distributionally robust optimization (DRO) scheme is a powerful way to alleviate algorithmic biases. Funding: This work was supported by the National Science Foundation [Grants 2342505 and 2343869] and the Chinese University of Hong Kong [Grant 4055191]. Supplemental Material: The online appendices are available at https://doi.org/10.1287/msom.2022.0230 .

Toward a Fairness-Aware Scoring System for Algorithmic Decision-Making

A Psychometric Framework for Evaluating Fairness in Algorithmic Decision Making: Differential Algorithmic Functioning

FairSight: Visual Analytics for Fairness in Decision Making

Wasserstein Robust Classification with Fairness Constraints

Facing the Challenges of Developing Fair Risk Scoring Models

Learning Optimal Fair Scoring Systems for Multi-Class Classification

A Justice-Based Framework for the Analysis of Algorithmic Fairness-Utility Trade-Offs

Balancing Competing Objectives with Noisy Data: Score-Based Classifiers for Welfare-Aware Machine Learning

On (assessing) the fairness of risk score models

The Fairness of Credit Scoring Models

Learning to be Fair: A Consequentialist Approach to Equitable Decision-Making

Understanding Fairness Surrogate Functions in Algorithmic Fairness

Fairness with Adaptive Weights.

Systemic Fairness

Fairness And Performance In Harmony: Data Debiasing Is All You Need

Fairness in Credit Scoring: Assessment, Implementation and Profit Implications

Fair Classification and Social Welfare

A Simulation Based Dynamic Evaluation Framework for System-wide Algorithmic Fairness

Learning Optimal and Fair Decision Trees for Non-Discriminative Decision-Making

Group Fairness in Prediction-Based Decision Making: From Moral Assessment to Implementation

Unbiased Subdata Selection for Fair Classification: A Unified Framework and Scalable Algorithms