Abstract:Problem definition: Data analytics models and machine learning algorithms are increasingly deployed to support consequential decision-making processes, from deciding which applicants will receive job offers and loans to university enrollments and medical interventions. However, recent studies show these models may unintentionally amplify human bias and yield significant unfavorable decisions to specific groups. Methodology/results: We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in the equality of opportunity criterion. We use a type-[Formula: see text] Wasserstein ambiguity set centered at the empirical distribution to represent distributional uncertainty and derive a conservative reformulation for the worst-case equal opportunity unfairness measure. We show that the model is equivalent to a mixed binary conic optimization problem, which standard off-the-shelf solvers can solve. We propose a convex, hinge-loss-based model for large problem instances whose reformulation does not incur binary variables to improve scalability. Moreover, we also consider the distributionally robust learning problem with a generic ground transportation cost to hedge against the label and sensitive attribute uncertainties. We numerically examine the performance of our proposed models on five real-world data sets related to individual analysis. Compared with the state-of-the-art methods, our proposed approaches significantly improve fairness with negligible loss of predictive accuracy in the testing data set. Managerial implications: Our paper raises awareness that bias may arise when predictive models are used in service and operations. It generally comes from human bias, for example, imbalanced data collection or low sample sizes, and is further amplified by algorithms. Incorporating fairness constraints and the distributionally robust optimization (DRO) scheme is a powerful way to alleviate algorithmic biases. Funding: This work was supported by the National Science Foundation [Grants 2342505 and 2343869] and the Chinese University of Hong Kong [Grant 4055191]. Supplemental Material: The online appendices are available at https://doi.org/10.1287/msom.2022.0230 .

Resource-constrained Fairness

Long-term Fairness For Real-time Decision Making: A Constrained Online Optimization Approach

Scarce Resource Allocations That Rely On Machine Learning Should Be Randomized

The Unfairness of Fair Machine Learning: Levelling down and strict egalitarianism by default

Implementing Fairness: the view from a FairDream

Metrizing Fairness

Enabling Long-term Fairness in Dynamic Resource Allocation

The Flawed Foundations of Fair Machine Learning

The Measure and Mismeasure of Fairness

Learning to be Fair: A Consequentialist Approach to Equitable Decision-Making

Multi-resource fairness: Objectives, algorithms and performance

Fairness Through Equality of Effort

Fairness With Minimal Harm: A Pareto-Optimal Approach For Healthcare

Price of Fairness for Allocating a Bounded Resource

Wasserstein Robust Classification with Fairness Constraints

Fairness Under Demographic Scarce Regime

Multiresource Allocation: Fairness-Efficiency Tradeoffs in a Unifying Framework.

Mathematical Notions vs. Human Perception of Fairness: A Descriptive Approach to Fairness for Machine Learning

The Fragility of Fairness: Causal Sensitivity Analysis for Fair Machine Learning

Unfairness Despite Awareness: Group-Fair Classification with Strategic Agents

Beyond Incompatibility: Trade-offs between Mutually Exclusive Fairness Criteria in Machine Learning and Law