Abstract:Societal biases encoded in real-world data can contaminate algorithmic decisions, perpetuating preexisting inequalities in domains such as employment and education. In the fair ranking literature, following the doctrine of affirmative action, fairness is enforced by means of a group-fairness constraint requiring "enough" individuals from protected groups in the top-k positions, for a ranking to be considered valid. However, which are the groups that need to be protected? And how much representation is "enough"? As the biases affecting the process may not always be directly observable nor measurable, these questions might be hard to answer in a principled way, especially when many different potentially discriminated subgroups exist. This paper addresses this issue by automatically identifying the disadvantaged groups in the data and mitigating their disparate representation in the final ranking. Our proposal leverages the notion of divergence to automatically identify which subgroups, defined as combination of sensitive attributes, show a statistically significant deviation, in terms of ranking utility, compared to the overall population. Subgroups with negative divergence experience a disadvantage. We formulate the problem of re-ranking instances to maximize the minimum subgroup divergence, while maintaining the new ranking as close as possible to the original one. We develop a method which is based on identifying the divergent subgroups and applying a re-ranking procedure which is monotonic w.r.t. the goal of maximizing the minimum divergence. Our experimental results show that our method effectively eliminates the existence of disadvantaged subgroups while producing rankings which are very close to the original ones.

Inferring inequality: Testing for median-preserving spreads in ordinal data

Identification-robust methods for comparing inequality with an application to regional disparities

Linearization and variance estimation of the Bonferroni inequality index

Inference on order restricted means of inverse Gaussian populations under heteroscedasticity

Measuring income inequality via percentile relativities

Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

Metrizing Fairness

Robust Estimation of Inequality from Binned Incomes

Equivalence of inequality indices: Three dimensions of impact revisited

A Nonparametric Test of Mth-Degree Inverse Stochastic Dominance

Testing for inequality constraints in singular models by trimming or winsorizing the variance matrix

Linear Regression Analysis with Inequality Constraints on the Regression Parameters Via Empirical Likelihood

Higher-Order Asymptotics and Its Application to Testing the Equality of the Examinee Ability Over Two Sets of Items

Testing two variances for superiority/non-inferiority and equivalence: Using the exhaustion algorithm for sample size allocation with cost

A Nonparametric Test of $m$th-degree Inverse Stochastic Dominance

Intrinsic tests for the equality of two correlated proportions

Intersectional fair ranking via subgroup divergence

Examining socioeconomic health disparities using a rank-dependent Rényi index

Measuring disparate outcomes of content recommendation algorithms with distributional inequality metrics

Testing the homogeneity of risk differences with sparse count data

The Asymptotic Properties of the One-Sample Spatial Rank Methods