Abstract:Machine learning (ML) is playing an increasingly important role in rendering decisions that affect a broad range of groups in society. ML models inform decisions in criminal justice, the extension of credit in banking, and the hiring practices of corporations. This posits the requirement of model fairness, which holds that automated decisions should be equitable with respect to protected features (e.g., gender, race, or age) that are often under-represented in the data. We postulate that this problem of under-representation has a corollary to the problem of imbalanced data learning. This class imbalance is often reflected in both classes and protected features. For example, one class (those receiving credit) may be over-represented with respect to another class (those not receiving credit) and a particular group (females) may be under-represented with respect to another group (males). A key element in achieving algorithmic fairness with respect to protected groups is the simultaneous reduction of class and protected group imbalance in the underlying training data, which facilitates increases in both model accuracy and fairness. We discuss the importance of bridging imbalanced learning and group fairness by showing how key concepts in these fields overlap and complement each other; and propose a novel oversampling algorithm, Fair Oversampling, that addresses both skewed class distributions and protected features. Our method: (i) can be used as an efficient pre-processing algorithm for standard ML algorithms to jointly address imbalance and group equity; and (ii) can be combined with fairness-aware learning algorithms to improve their robustness to varying levels of class imbalance. Additionally, we take a step toward bridging the gap between fairness and imbalanced learning with a new metric, Fair Utility, that combines balanced accuracy with fairness.

FAIRLABEL: Correcting Bias in Labels

Bias-Tolerant Fair Classification

How to be fair? A study of label and selection bias

On Comparing Fair Classifiers under Data Bias

Bias in Machine Learning Software: Why? How? What to do?

Simultaneous Improvement of ML Model Fairness and Performance by Identifying Bias in Data

Mitigating Label Bias in Machine Learning: Fairness Through Confident Learning

Fair-OBNC: Correcting Label Noise for Fairer Datasets

Quantifying and mitigating the impact of label errors on model disparity metrics

Who Decides if AI is Fair? The Labels Problem in Algorithmic Auditing

Investigating Labeler Bias in Face Annotation for Machine Learning

Recovering from Biased Data: Can Fairness Constraints Improve Accuracy?

Normalise for Fairness: A Simple Normalisation Technique for Fairness in Regression Machine Learning Problems

AIM: Attributing, Interpreting, Mitigating Data Unfairness

Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoML

Fairness Evaluation in Presence of Biased Noisy Labels

Towards A Holistic View of Bias in Machine Learning: Bridging Algorithmic Fairness and Imbalanced Learning

Interactive Active Learning for Fairness with Partial Group Label

Fairway: SE Principles for Building Fairer Software

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

Editable Fairness: Fine-Grained Bias Mitigation in Language Models