Abstract:Machine learning (ML) is playing an increasingly important role in rendering decisions that affect a broad range of groups in society. ML models inform decisions in criminal justice, the extension of credit in banking, and the hiring practices of corporations. This posits the requirement of model fairness, which holds that automated decisions should be equitable with respect to protected features (e.g., gender, race, or age) that are often under-represented in the data. We postulate that this problem of under-representation has a corollary to the problem of imbalanced data learning. This class imbalance is often reflected in both classes and protected features. For example, one class (those receiving credit) may be over-represented with respect to another class (those not receiving credit) and a particular group (females) may be under-represented with respect to another group (males). A key element in achieving algorithmic fairness with respect to protected groups is the simultaneous reduction of class and protected group imbalance in the underlying training data, which facilitates increases in both model accuracy and fairness. We discuss the importance of bridging imbalanced learning and group fairness by showing how key concepts in these fields overlap and complement each other; and propose a novel oversampling algorithm, Fair Oversampling, that addresses both skewed class distributions and protected features. Our method: (i) can be used as an efficient pre-processing algorithm for standard ML algorithms to jointly address imbalance and group equity; and (ii) can be combined with fairness-aware learning algorithms to improve their robustness to varying levels of class imbalance. Additionally, we take a step toward bridging the gap between fairness and imbalanced learning with a new metric, Fair Utility, that combines balanced accuracy with fairness.

Fine-tuning a Biased Model for Improving Fairness

Bias Mitigation in Fine-tuning Pre-trained Models for Enhanced Fairness and Efficiency

Last-Layer Fairness Fine-tuning is Simple and Effective for Neural Networks

Towards Fair and Calibrated Models

FairIF: Boosting Fairness in Deep Learning via Influence Functions with Validation Set Sensitive Attributes

Editable Fairness: Fine-Grained Bias Mitigation in Language Models

FairFix: Enhancing Fairness of Pre-Trained Deep Neural Networks with Scarce Data Resources

Simultaneous Improvement of ML Model Fairness and Performance by Identifying Bias in Data

BMFT: Achieving Fairness via Bias-based Weight Masking Fine-tuning

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

AdapFair: Ensuring Continuous Fairness for Machine Learning Operations

A Large-Scale Empirical Study on Improving the Fairness of Image Classification Models

Bias-Tolerant Fair Classification

Fairness with Adaptive Weights.

Collapsed Language Models Promote Fairness

Towards A Holistic View of Bias in Machine Learning: Bridging Algorithmic Fairness and Imbalanced Learning

Model Debiasing via Gradient-based Explanation on Representation

The Fairness Stitch: Unveiling the Potential of Model Stitching in Neural Network De-Biasing

Fair Bilevel Neural Network (FairBiNN): On Balancing fairness and accuracy via Stackelberg Equilibrium

Causal-Debias: Unifying Debiasing in Pretrained Language Models and Fine-tuning Via Causal Invariant Learning

Low-rank finetuning for LLMs: A fairness perspective