Usman Gohar,Zeyu Tang,Jialu Wang,Kun Zhang,Peter L. Spirtes,Yang Liu,Lu Cheng
Abstract:The widespread integration of Machine Learning systems in daily life, particularly in high-stakes domains, has raised concerns about the fairness implications. While prior works have investigated static fairness measures, recent studies reveal that automated decision-making has long-term implications and that off-the-shelf fairness approaches may not serve the purpose of achieving long-term fairness. Additionally, the existence of feedback loops and the interaction between models and the environment introduces additional complexities that may deviate from the initial fairness goals. In this survey, we review existing literature on long-term fairness from different perspectives and present a taxonomy for long-term fairness studies. We highlight key challenges and consider future research directions, analyzing both current issues and potential further explorations.
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the limitations of fairness measures in existing machine - learning systems. In particular, most of these measures are based on static fairness concepts and cannot effectively address fairness challenges in long - term dynamic environments. Specifically:
1. **Limitations of Static Fairness**: Traditional fairness research mainly focuses on static environments, that is, assuming that the environment and the system are constant, and only focuses on immediate impacts and the intervention effects at a single point in time. However, this short - sighted fairness concept usually ignores the dynamic changes of the system (dynamic fairness) and the consequences over a long period of time (long - term fairness).
2. **The Impact of Feedback Loops and Model - Environment Interactions**: In the real world, the interaction between automated decision - making systems and the environment will introduce additional complexity, which may lead to deviations from the initial fairness goals. For example, in predictive policing, allocating more police forces in a specific area at the initial stage will lead to more incidents being reported, which in turn will lead to continuous monitoring of the community and increased marginalization.
3. **The Importance of Long - Term Fairness**: To ensure that fairness is not limited to short - term effects, long - term, multi - time - step fairness issues also need to be considered. This includes, but is not limited to, sequential fairness, distribution shift, delayed impact, and performative prediction, etc.
To solve these problems, the paper proposes a comprehensive framework to understand and classify different aspects of long - term fairness, and explores various methods and techniques for achieving fair results in dynamic and non - static environments. Through this effort, the authors identify multiple dimensions and application scenarios of long - term fairness, and provide a rich review of existing research to explore diverse ways and considerations for achieving long - term fairness.
### Formula Summary
- **Definition of Bounded - Effort Unfairness**:
\[
P\left(\max_{\mu(\Delta x) \leq \delta} f(x + \Delta x) \geq 0.5, f(x) < 0.5 \mid g = g'\right) = P\left(\max_{\mu(\Delta x) \leq \delta} f(x + \Delta x) \geq 0.5, f(x) < 0.5\right)
\]
where $\mu(\Delta x) \leq \delta$ restricts the effort level within a certain range.
- **Definition of Equal Recourse**:
\[
E\left[\min_{f(x + \Delta x) \geq 0.5} \mu(\Delta x) \mid f(x) < 0.5, g = g'\right] = E\left[\min_{f(x + \Delta x) \geq 0.5} \mu(\Delta x) \mid f(x) < 0.5\right]
\]
- **Definition of Fair Causal Recourse**:
\[
\min_{f(x') \geq 0.5} \mu(x' - x(g, u)) = \min_{f(x') \geq 0.5} \mu(x' - x(g', u))
\]
- **Definition of Return Parity**:
\[
\eta(\pi_0) - \eta(\pi_1) \leq \epsilon
\]
where $\eta(\pi)$ represents the cumulative reward under strategy $\pi$.
- **Definition of Long - Term Benefit Rate**:
\[
\frac{\eta_S^g(\pi)}{\eta_D^g(\pi)}
\]
where $\eta_S^g(\pi)$ and $\eta_D^g(\pi)$ represent the cumulative values of group supply and demand respectively.
Through these