Abstract:Machine learning (ML) is playing an increasingly important role in rendering decisions that affect a broad range of groups in society. ML models inform decisions in criminal justice, the extension of credit in banking, and the hiring practices of corporations. This posits the requirement of model fairness, which holds that automated decisions should be equitable with respect to protected features (e.g., gender, race, or age) that are often under-represented in the data. We postulate that this problem of under-representation has a corollary to the problem of imbalanced data learning. This class imbalance is often reflected in both classes and protected features. For example, one class (those receiving credit) may be over-represented with respect to another class (those not receiving credit) and a particular group (females) may be under-represented with respect to another group (males). A key element in achieving algorithmic fairness with respect to protected groups is the simultaneous reduction of class and protected group imbalance in the underlying training data, which facilitates increases in both model accuracy and fairness. We discuss the importance of bridging imbalanced learning and group fairness by showing how key concepts in these fields overlap and complement each other; and propose a novel oversampling algorithm, Fair Oversampling, that addresses both skewed class distributions and protected features. Our method: (i) can be used as an efficient pre-processing algorithm for standard ML algorithms to jointly address imbalance and group equity; and (ii) can be combined with fairness-aware learning algorithms to improve their robustness to varying levels of class imbalance. Additionally, we take a step toward bridging the gap between fairness and imbalanced learning with a new metric, Fair Utility, that combines balanced accuracy with fairness.

Auditing ML Models for Individual Bias and Unfairness

Statistical inference for individual fairness

Statistical Inference for Fairness Auditing

Auditing Fairness by Betting

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

Analyzing Fairness of Computer Vision and Natural Language Processing Models

Simultaneous Improvement of ML Model Fairness and Performance by Identifying Bias in Data

Fix Fairness, Don't Ruin Accuracy: Performance Aware Fairness Repair using AutoML

Auditing Predictive Models for Intersectional Biases

Towards A Holistic View of Bias in Machine Learning: Bridging Algorithmic Fairness and Imbalanced Learning

Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN

FairSense: Long-Term Fairness Analysis of ML-Enabled Systems

Do the Machine Learning Models on a Crowd Sourced Platform Exhibit Bias? An Empirical Study on Model Fairness

fairmodels: A Flexible Tool For Bias Detection, Visualization, And Mitigation

A Sandbox Tool to Bias(Stress)-Test Fairness Algorithms

Fairness And Performance In Harmony: Data Debiasing Is All You Need

Bias in Machine Learning Software: Why? How? What to do?

Fairer and more accurate, but for whom?

Ensuring Fairness with Transparent Auditing of Quantitative Bias in AI Systems

Aleatoric and Epistemic Discrimination: Fundamental Limits of Fairness Interventions