Abstract:Software bias is an increasingly important operational concern for software engineers. We present a large-scale, comprehensive empirical study of 17 representative bias mitigation methods for Machine Learning (ML) classifiers, evaluated with 11 ML performance metrics (e.g., accuracy), 4 fairness metrics, and 20 types of fairness-performance trade-off assessment, applied to 8 widely-adopted software decision tasks. The empirical coverage is much more comprehensive, covering the largest numbers of bias mitigation methods, evaluation metrics, and fairness-performance trade-off measures compared to previous work on this important software property. We find that (1) the bias mitigation methods significantly decrease ML performance in 53% of the studied scenarios (ranging between 42%~66% according to different ML performance metrics); (2) the bias mitigation methods significantly improve fairness measured by the 4 used metrics in 46% of all the scenarios (ranging between 24%~59% according to different fairness metrics); (3) the bias mitigation methods even lead to decrease in both fairness and ML performance in 25% of the scenarios; (4) the effectiveness of the bias mitigation methods depends on tasks, models, the choice of protected attributes, and the set of metrics used to assess fairness and ML performance; (5) there is no bias mitigation method that can achieve the best trade-off in all the scenarios. The best method that we find outperforms other methods in 30% of the scenarios. Researchers and practitioners need to choose the bias mitigation method best suited to their intended application scenario(s).

Reconciling modern machine-learning practice and the classical bias–variance trade-off

Reconciling modern machine learning practice and the bias-variance trade-off

Classical Statistical (In-Sample) Intuitions Don't Generalize Well: A Note on Bias-Variance Tradeoffs, Overfitting and Moving from Fixed to Random Designs

It's an Alignment, Not a Trade-off: Revisiting Bias and Variance in Deep Models

A Modern Take on the Bias-Variance Tradeoff in Neural Networks

Rethinking Bias-Variance Trade-off for Generalization of Neural Networks

Understanding Bias in Machine Learning

An Effective Theory of Bias Amplification

Towards Fair Machine Learning Software: Understanding and Addressing Model Bias Through Counterfactual Thinking

Fantastic Biases (What are They) and Where to Find Them

A Mathematical Foundation for Robust Machine Learning based on Bias-Variance Trade-off

Revisiting Optimism and Model Complexity in the Wake of Overparameterized Machine Learning

On the Bias-Variance Tradeoff: Textbooks Need an Update

Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training

Unraveling overoptimism and publication bias in ML-driven science

A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers

Is There a Trade-Off Between Fairness and Accuracy? A Perspective Using Mismatched Hypothesis Testing

Impact of Biases in Big Data

Algorithmic Bias, Generalist Models,and Clinical Medicine

The fairness-accuracy landscape of neural classifiers

Machine Learning Bias in Computer Vision: Why do I have to care?