Abstract:When a model's performance differs across socially or culturally relevant groups--like race, gender, or the intersections of many such groups--it is often called "biased." While much of the work in algorithmic fairness over the last several years has focused on developing various definitions of model fairness (the absence of group-wise model performance disparities) and eliminating such "bias," much less work has gone into rigorously measuring it. In practice, it important to have high quality, human digestible measures of model performance disparities and associated uncertainty quantification about them that can serve as inputs into multi-faceted decision-making processes. In this paper, we show both mathematically and through simulation that many of the metrics used to measure group-wise model performance disparities are themselves statistically biased estimators of the underlying quantities they purport to represent. We argue that this can cause misleading conclusions about the relative group-wise model performance disparities along different dimensions, especially in cases where some sensitive variables consist of categories with few members. We propose the "double-corrected" variance estimator, which provides unbiased estimates and uncertainty quantification of the variance of model performance across groups. It is conceptually simple and easily implementable without statistical software package or numerical optimization. We demonstrate the utility of this approach through simulation and show on a real dataset that while statistically biased estimators of group-wise model performance disparities indicate statistically significant differences, when accounting for statistical bias in the estimator, the estimated between-group disparities are no longer statistically significant.

A simulation-based estimation method for bias reduction

Performance Bound Approximation for Bearing Estimation with Bias Correction

Barankin Bound for Bearing Estimation with Bias Correction

Linking Statistical Estimation and Decision Making Through Simulation

MODEL-BASED ANALYSIS TO IMPROVE THE PERFORMANCE OF ITERATIVE SIMULATIONS

Eliminating Ratio Bias for Gradient-based Simulated Parameter Estimation

PSEUDO SEPARATED—BIAS ESTIMATION FOR A CLASS OF NONLINEAR SYSTEMS WITH OUTPUT BIAS

Bias Reduction in Sample-Based Optimization

Empirical bias-reducing adjustments to estimating functions

Bias Correction and Robust Inference in Semiparametric Models

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

De-biasing "bias" measurement

Efficient estimation and correction of selection-induced bias with order statistics

Balancing Search and Estimation in Random Search Based Stochastic Simulation Optimization

Learning to Estimate Without Bias

Fine-Grained Dynamic Framework for Bias-Variance Joint Optimization on Data Missing Not at Random

Cost-aware Simulation-based Inference

Embedded Model Bias Quantification with Measurement Noise for Bayesian Model Calibration

Active Sequential Posterior Estimation for Sample-Efficient Simulation-Based Inference

Statistical Uncertainty Analysis for Stochastic Simulation

A new efficient simulation method based on Bayes' theorem and importance sampling Markov chain simulation to estimate the failure-probability-based global sensitivity measure