Abstract:This research seeks to benefit the software engineering society by providing a simple yet effective pre-processing approach to achieve equalized odds fairness in machine learning software. Fairness issues have attracted increasing attention since machine learning software is increasingly used for high-stakes and high-risk decisions. Amongst all the existing fairness notions, this work specifically targets "equalized odds" given its advantage in always allowing perfect classifiers. Equalized odds requires that members of every demographic group do not receive disparate mistreatment. Prior works either optimize for an equalized odds related metric during the learning process like a black-box, or manipulate the training data following some intuition. This work studies the root cause of the violation of equalized odds and how to tackle it. We found that equalizing the class distribution in each demographic group with sample weights is a necessary condition for achieving equalized odds without modifying the normal training process. In addition, an important partial condition for equalized odds (zero average odds difference) can be guaranteed when the class distributions are weighted to be not only equal but also balanced (1:1). Based on these analyses, we proposed FairBalance, a pre-processing algorithm which balances the class distribution in each demographic group by assigning calculated weights to the training data. On eight real-world datasets, our empirical results show that, at low computational overhead, the proposed pre-processing algorithm FairBalance can significantly improve equalized odds without much, if any damage to the utility. FairBalance also outperforms existing state-of-the-art approaches in terms of equalized odds. To facilitate reuse, reproduction, and validation, we made our scripts available at <a class="link-external link-https" href="https://github.com/hil-se/FairBalance" rel="external noopener nofollow">this https URL</a>.

Flexible Fairness-Aware Learning via Inverse Conditional Permutation

Achieving Equalized Odds by Resampling Sensitive Attributes

Learning Optimal Fair Policies

Fairness Through Equality of Effort

Estimating and Controlling for Equalized Odds via Sensitive Attribute Predictors

Fair Bayes-Optimal Classifiers Under Predictive Parity

Metrizing Fairness

Unfairness Despite Awareness: Group-Fair Classification with Strategic Agents

Fairness in Supervised Learning: An Information Theoretic Approach

FAIRM: Learning invariant representations for algorithmic fairness and domain generalization with minimax optimality

Differentially Private Fair Learning

CONFAIR: Configurable and Interpretable Algorithmic Fairness

Equalised Odds is not Equal Individual Odds: Post-processing for Group and Individual Fairness

Learning fair representations via an adversarial framework

Bayes-Optimal Fair Classification with Linear Disparity Constraints via Pre-, In-, and Post-processing

Fair Classification via Unconstrained Optimization

Intrinsic Fairness-Accuracy Tradeoffs under Equalized Odds

Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness

Learning to be Fair: A Consequentialist Approach to Equitable Decision-Making

Algorithmic Decision Making with Conditional Fairness

FairBalance: How to Achieve Equalized Odds With Data Pre-processing