Abstract:The most prevalent notions of fairness in machine learning are statistical definitions: they fix a small collection of pre-defined groups, and then ask for parity of some statistic of the classifier across these groups. Constraints of this form are susceptible to intentional or inadvertent "fairness gerrymandering", in which a classifier appears to be fair on each individual group, but badly violates the fairness constraint on one or more structured subgroups defined over the protected attributes. We propose instead to demand statistical notions of fairness across exponentially (or infinitely) many subgroups, defined by a structured class of functions over the protected attributes. This interpolates between statistical definitions of fairness and recently proposed individual notions of fairness, but raises several computational challenges. It is no longer clear how to audit a fixed classifier to see if it satisfies such a strong definition of fairness. We prove that the computational problem of auditing subgroup fairness for both equality of false positive rates and statistical parity is equivalent to the problem of weak agnostic learning, which means it is computationally hard in the worst case, even for simple structured subclasses. We then derive two algorithms that provably converge to the best fair classifier, given access to oracles which can solve the agnostic learning problem. The algorithms are based on a formulation of subgroup fairness as a two-player zero-sum game between a Learner and an Auditor. Our first algorithm provably converges in a polynomial number of steps. Our second algorithm enjoys only provably asymptotic convergence, but has the merit of simplicity and faster per-step computation. We implement the simpler algorithm using linear regression as a heuristic oracle, and show that we can effectively both audit and learn fair classifiers on real datasets.

Fairness in Forecasting and Learning Linear Dynamical Systems

Learning Informative Representation for Fairness-aware Multivariate Time-series Forecasting: A Group-based Perspective

On Learning Fairness and Accuracy on Multiple Subgroups

Group Fairness by Probabilistic Modeling with Latent Fair Decisions

Learning of Linear Dynamical Systems as a Non-Commutative Polynomial Optimization Problem

Fair Inference for Discrete Latent Variable Models

Learning Fair Policies for Multi-stage Selection Problems from Observational Data

Striking a Balance in Fairness for Dynamic Systems Through Reinforcement Learning

Metrizing Fairness

Flexible and Adaptive Fairness-aware Learning in Non-stationary Data Streams.

Dynamic Modeling and Equilibria in Fair Decision Making

Achieving Group Fairness through Independence in Predictive Process Monitoring

Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness

Learning by Grouping: A Multilevel Optimization Framework for Improving Fairness in Classification without Losing Accuracy

Designing Long-term Group Fair Policies in Dynamical Systems

Learning to be Fair: A Consequentialist Approach to Equitable Decision-Making

Statistical learning for constrained functional parameters in infinite-dimensional models with applications in fair machine learning

FairSense: Long-Term Fairness Analysis of ML-Enabled Systems

Long-term Fairness For Real-time Decision Making: A Constrained Online Optimization Approach

Unfairness Despite Awareness: Group-Fair Classification with Strategic Agents

Unified Fairness from Data to Learning Algorithm