Abstract:The use of algorithmic decision making systems in domains which impact the financial, social, and political well-being of people has created a demand for these decision making systems to be "fair" under some accepted notion of equity. This demand has in turn inspired a large body of work focused on the development of fair learning algorithms which are then used in lieu of their conventional counterparts. Most analysis of such fair algorithms proceeds from the assumption that the people affected by the algorithmic decisions are represented as immutable feature vectors. However, strategic agents may possess both the ability and the incentive to manipulate this observed feature vector in order to attain a more favorable outcome. We explore the impact that strategic agent behavior could have on fair classifiers and derive conditions under which this behavior leads to fair classifiers becoming less fair than their conventional counterparts under the same measure of fairness that the fair classifier takes into account. These conditions are related to the the way in which the fair classifier remedies unfairness on the original unmanipulated data: fair classifiers which remedy unfairness by becoming more selective than their conventional counterparts are the ones that become less fair than their counterparts when agents are strategic. We further demonstrate that both the increased selectiveness of the fair classifier, and consequently the loss of fairness, arises when performing fair learning on domains in which the advantaged group is overrepresented in the region near (and on the beneficial side of) the decision boundary of conventional classifiers. Finally, we observe experimentally, using several datasets and learning methods, that this fairness reversal is common, and that our theoretical characterization of the fairness reversal conditions indeed holds in most such cases.

Dancing in the Shadows: Harnessing Ambiguity for Fairer Classifiers

Fairness through Aleatoric Uncertainty

Towards A Holistic View of Bias in Machine Learning: Bridging Algorithmic Fairness and Imbalanced Learning

AdaFair: Cumulative Fairness Adaptive Boosting

Fairness Under Demographic Scarce Regime

Fairness through awareness

Fairness And Performance In Harmony: Data Debiasing Is All You Need

Unfairness Despite Awareness: Group-Fair Classification with Strategic Agents

Loss-Aversively Fair Classification

Taking Advantage of Multitask Learning for Fair Classification

Learning fair representations via an adversarial framework

Understanding Unfairness in Fraud Detection through Model and Data Bias Interactions

Automatic Fairness Testing of Neural Classifiers through Adversarial Sampling

Fairness with Adaptive Weights.

FairlyUncertain: A Comprehensive Benchmark of Uncertainty in Algorithmic Fairness

Active Fairness in Algorithmic Decision Making

Auditing fairness under unawareness through counterfactual reasoning

Uncertainty-Aware Fairness-Adaptive Classification Trees

Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment

Implementing Fairness: the view from a FairDream

AdapFair: Ensuring Continuous Fairness for Machine Learning Operations