Preference-Informed Fairness

Michael P. Kim,Aleksandra Korolova,Guy N. Rothblum,Gal Yona
DOI: https://doi.org/10.48550/arXiv.1904.01793
2019-09-11
Abstract:We study notions of fairness in decision-making systems when individuals have diverse preferences over the possible outcomes of the decisions. Our starting point is the seminal work of Dwork et al. which introduced a notion of individual fairness (IF): given a task-specific similarity metric, every pair of individuals who are similarly qualified according to the metric should receive similar outcomes. We show that when individuals have diverse preferences over outcomes, requiring IF may unintentionally lead to less-preferred outcomes for the very individuals that IF aims to protect. A natural alternative to IF is the classic notion of fair division, envy-freeness (EF): no individual should prefer another individual's outcome over their own. Although EF allows for solutions where all individuals receive a highly-preferred outcome, EF may also be overly-restrictive. For instance, if many individuals agree on the best outcome, then if any individual receives this outcome, they all must receive it, regardless of each individual's underlying qualifications for the outcome. We introduce and study a new notion of preference-informed individual fairness (PIIF) that is a relaxation of both individual fairness and envy-freeness. At a high-level, PIIF requires that outcomes satisfy IF-style constraints, but allows for deviations provided they are in line with individuals' preferences. We show that PIIF can permit outcomes that are more favorable to individuals than any IF solution, while providing considerably more flexibility to the decision-maker than EF. In addition, we show how to efficiently optimize any convex objective over the outcomes subject to PIIF for a rich class of individual preferences. Finally, we demonstrate the broad applicability of the PIIF framework by extending our definitions and algorithms to the multiple-task targeted advertising setting introduced by Dwork and Ilvento.
Machine Learning,Computers and Society,Data Structures and Algorithms
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of how to define and achieve fairness in decision - making systems when individuals have different preferences for possible outcomes. Specifically, the author focuses on: 1. **Limitations of Individual Fairness (IF)**: - Individual Fairness (IF) requires that similar individuals should receive similar results. However, when individuals have different preferences for outcomes, strictly following IF may lead to some individuals (especially protected minorities) getting undesirable results. For example, in the case of a career fair, if three equally qualified candidates are assigned interview opportunities according to the IF principle, they will not be able to obtain their most preferred interview opportunities. 2. **Limitations of Envy - Freeness (EF)**: - Envy - Freeness (EF) requires that no one will prefer someone else's result to their own. Although EF can ensure that everyone gets a satisfactory result, it is too restrictive for decision - makers. For example, if many people agree on a best result, then once anyone obtains this result, everyone must obtain it, regardless of each person's qualifications. 3. **Introducing Preference - Informed Individual Fairness (PIIF)**: - To solve the above problems, the author proposes a new concept - Preference - Informed Individual Fairness (PIIF). PIIF is a fairness definition that relaxes IF and EF, allowing deviation from strict fairness requirements when satisfying individual preferences. Specifically, PIIF requires that each individual's result either meets the requirements of IF or the individual prefers their actual result to an alternative result that meets the requirements of IF. 4. **Optimization and Application**: - The paper also shows how to efficiently optimize convex objective functions under PIIF constraints and extends the PIIF framework to multi - task targeted advertising settings to meet the fairness requirements in large - scale personalized advertising systems. ### Formula Summary - **Individual Fairness (IF)**: \[ D(\pi(i), \pi(j)) \leq d(i, j) \] where \(D\) is the distance measure between two allocations and \(d\) is the similarity measure between individuals. - **Envy - Freeness (EF)**: \[ \pi(i) \succeq_i \pi(j) \] indicating that for all individuals \(i\) and other individuals \(j\), individual \(i\) will not prefer the allocation result of \(j\). - **Preference - Informed Individual Fairness (PIIF)**: \[ \exists p_{i;j} \in \Delta(C) \text{ s.t. } D(p_{i;j}, \pi(j)) \leq d(i, j) \quad \text{and} \quad \pi(i) \succeq_i p_{i;j} \] that is, there exists an alternative allocation \(p_{i;j}\) such that it satisfies the IF condition and individual \(i\) prefers their actual allocation \(\pi(i)\) to \(p_{i;j}\). Through these formulas, the author provides a new framework to balance individual preferences and fairness requirements, thereby achieving more reasonable decision - making in complex social environments.