Abstract:In recent years, there has been increasing interest in causal reasoning for designing fair decision-making systems due to its compatibility with legal frameworks, interpretability for human stakeholders, and robustness to spurious correlations inherent in observational data, among other factors. The recent attention to causal fairness, however, has been accompanied with great skepticism due to practical and epistemological challenges with applying current causal fairness approaches in the literature. Motivated by the long-standing empirical work on causality in econometrics, social sciences, and biomedical sciences, in this paper we lay out the conditions for appropriate application of causal fairness under the "potential outcomes framework." We highlight key aspects of causal inference that are often ignored in the causal fairness literature. In particular, we discuss the importance of specifying the nature and timing of interventions on social categories such as race or gender. Precisely, instead of postulating an intervention on immutable attributes, we propose a shift in focus to their perceptions and discuss the implications for fairness evaluation. We argue that such conceptualization of the intervention is key in evaluating the validity of causal assumptions and conducting sound causal analysis including avoiding post-treatment bias. Subsequently, we illustrate how causality can address the limitations of existing fairness metrics, including those that depend upon statistical correlations. Specifically, we introduce causal variants of common statistical notions of fairness, and we make a novel observation that under the causal framework there is no fundamental disagreement between different notions of fairness. Finally, we conduct extensive experiments where we demonstrate our approach for evaluating and mitigating unfairness, specially when post-treatment variables are present.

Algorithmic Accountability in Context. Socio-Technical Perspectives on Structural Causal Models

Designing Accountable Systems

Expressing Accountability Patterns using Structural Causal Models

Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning

Algorithmic policing accountability: eight sociotechnical challenges

Causal Responsibility Attribution for Human-AI Collaboration

A Model for Evaluating Algorithmic Systems Accountability

A relationship and not a thing: A relational approach to algorithmic accountability and assessment documentation

Accountable and Explainable Methods for Complex Reasoning over Text

Computability, Complexity, Consistency and Controllability: A Four C's Framework for cross-disciplinary Ethical Algorithm Research

Structural Causal Models Reveal Confounder Bias in Linear Program Modelling

Beyond Structural Causal Models: Causal Constraints Models

Causal Modeling in Multi-Context Systems: Distinguishing Multiple Context-Specific Causal Graphs which Account for Observational Support

Beyond Model Interpretability: Socio-Structural Explanations in Machine Learning

Promises and Challenges of Causality for Ethical Machine Learning

Foundations of Structural Causal Models with Cycles and Latent Variables

Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems

Distribution-consistency Structural Causal Models

Understanding the Building Blocks of Accountability in Software Engineering

Extending the Machine Learning Abstraction Boundary: A Complex Systems Approach to Incorporate Societal Context