Abstract:We study notions of fairness in decision-making systems when individuals have diverse preferences over the possible outcomes of the decisions. Our starting point is the seminal work of Dwork et al. which introduced a notion of individual fairness (IF): given a task-specific similarity metric, every pair of individuals who are similarly qualified according to the metric should receive similar outcomes. We show that when individuals have diverse preferences over outcomes, requiring IF may unintentionally lead to less-preferred outcomes for the very individuals that IF aims to protect. A natural alternative to IF is the classic notion of fair division, envy-freeness (EF): no individual should prefer another individual's outcome over their own. Although EF allows for solutions where all individuals receive a highly-preferred outcome, EF may also be overly-restrictive. For instance, if many individuals agree on the best outcome, then if any individual receives this outcome, they all must receive it, regardless of each individual's underlying qualifications for the outcome. We introduce and study a new notion of preference-informed individual fairness (PIIF) that is a relaxation of both individual fairness and envy-freeness. At a high-level, PIIF requires that outcomes satisfy IF-style constraints, but allows for deviations provided they are in line with individuals' preferences. We show that PIIF can permit outcomes that are more favorable to individuals than any IF solution, while providing considerably more flexibility to the decision-maker than EF. In addition, we show how to efficiently optimize any convex objective over the outcomes subject to PIIF for a rich class of individual preferences. Finally, we demonstrate the broad applicability of the PIIF framework by extending our definitions and algorithms to the multiple-task targeted advertising setting introduced by Dwork and Ilvento.

Equitable preference relations on infinite utility streams

Extended Gini index

Maximal Social Welfare Relations on Infinite Populations Satisfying Permutation Invariance

Fair Division with Interdependent Values

On Strongly-equitable Social Welfare Orders Without the Axiom of Choice

Two Birds With One Stone: Fairness and Welfare via Transfers

A remark on utility streams

A New Approach to Fair Distribution of Welfare

Mechanisms and axiomatics for division problems with single-dipped preferences

Almost Envy-Freeness under Weakly Lexicographic Preferences

Fair Division with Allocator's Preference

The inversion paradox, and classification of fairness notions

Preference-Informed Fairness

Fair Division of Indivisible Goods Among Strategic Agents

Social Welfare in One-sided Matching Markets without Money

Fair Division with Two-Sided Preferences

The Price of Fairness for Indivisible Goods

Uniform Welfare Guarantees Under Identical Subadditive Valuations

On the Proximity of Markets with Integral Equilibria

On Truthful Mechanisms without Pareto-efficiency: Characterizations and Fairness

Fairness Concepts for Indivisible Items with Externalities