Abstract:While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such systems -- pertaining both to individuals and groups -- is one relevant consideration in this space; algorithms can discriminate people across various protected characteristics regardless of whether these properties are included in the data or discernible through proxy variables. To date, this notion has predominantly been studied for a fixed model, often under different classification thresholds, striving to identify and eradicate undesirable, discriminative and possibly unlawful aspects of its operation. Here, we backtrack on this fixed model assumption to propose and explore a novel definition of cross-model fairness where individuals can be harmed when one predictor is chosen ad hoc from a group of equally well performing models, i.e., in view of utility-based model multiplicity. Since a person may be classified differently across models that are otherwise considered equivalent, this individual could argue for a predictor granting them the most favourable outcome, employing which may have adverse effects on other people. We introduce this scenario with a two-dimensional example and linear classification; then, we present a comprehensive empirical study based on real-life predictive models and data sets that are popular with the algorithmic fairness community; finally, we investigate analytical properties of cross-model fairness and its ramifications in a broader context. Our findings suggest that such unfairness can be readily found in real life and it may be difficult to mitigate by technical means alone as doing so is likely to degrade predictive performance.

Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts

Concurrent surrogate model selection (COSMOS): optimizing model type, kernel function, and hyper-parameters

Conservative Prediction via Data-Driven Confidence Minimization

Robust Conformal Prediction under Distribution Shift via Physics-Informed Structural Causal Model

Evaluating Model Performance Under Worst-case Subpopulations

Predictive Multiplicity in Probabilistic Classification

Cross-model Fairness: Empirical Study of Fairness and Ethics Under Model Multiplicity

Causally Regularized Learning with Agnostic Data Selection Bias

COSSMO: predicting competitive alternative splice site selection using deep learning

A Robust Classifier Under Missing-Not-At-Random Sample Selection Bias

Robust Validation: Confident Predictions Even When Distributions Shift

Structurally Aware Robust Model Selection for Mixtures

Robustness to Spurious Correlations via Human Annotations

Fairer and more accurate, but for whom?

Efficient and Multiply Robust Risk Estimation under General Forms of Dataset Shift

Robustness to Spurious Correlations in Text Classification via Automatically Generated Counterfactuals

Robust Model Selection with Application in Single-Cell Multiomics Data

Compositional Risk Minimization

SCOD: From Heuristics to Theory

Predicting Census Survey Response Rates With Parsimonious Additive Models and Structured Interactions

Change is Hard: A Closer Look at Subpopulation Shift