Abstract:As applications of machine learning become increasingly widespread, the need to ensure model accuracy and fairness while protecting the privacy of user data becomes more pronounced. On this note, this paper introduces a federated learning training model, which allow clients to simultaneously learn their model and update the associated parameters on a centralized server. In our approach, we seek to achieve an acceptable trade-off between privacy, accuracy, and model fairness by using differential privacy (DP), which also helps to minimize privacy risks by protecting the presence of a specific sample in the training data. Machine learning models can, however, exhibit unintended behaviors, such as unfairness, which result in groups with certain sensitive characteristics (e.g., gender) receiving different patterns of outcomes. Hence, we discuss the fairness and privacy effect of local DP and global DP when applied to federated learning by designing a fair and privacy quantification mechanism. In doing so, we can achieve an acceptable trade-off between accuracy, privacy, and model fairness. We quantify the level of fairness based on the constraints of three definitions of fairness, including demographic parity, equal odds, and equality of opportunity. Finally, findings from our extensive experiments conducted on three real-world datasets with class imbalance demonstrate the positive effect of local and global DP on fairness. Our study also shows that privacy can come at the cost of fairness, as stricter privacy can intensify discrimination. Hence, we posit that careful parameter selection can potentially help achieve a more effective trade-off between utility, bias, and privacy.

AI Fairness–From Machine Learning to Federated Learning

A Multivocal Literature Review on Privacy and Fairness in Federated Learning

Federated Learning Meets Fairness and Differential Privacy

Fairness issues, current approaches, and challenges in machine learning models

Fairness in Machine Learning: Definition, Testing, Debugging, and Application

Federated Fairness Analytics: Quantifying Fairness in Federated Learning

On the Legal Compatibility of Fairness Definitions

Privacy, accuracy, and model fairness trade-offs in federated learning

Fairness Without Demographics in Human-Centered Federated Learning

A Survey on Group Fairness in Federated Learning: Challenges, Taxonomy of Solutions and Directions for Future Research

The Impossibility of Fair LLMs

The Flawed Foundations of Fair Machine Learning

A Review on Fairness in Machine Learning

What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective

Bias, Fairness and Accountability with Artificial Intelligence and Machine Learning Algorithms

What Is Fairness? On the Role of Protected Attributes and Fictitious Worlds

Privacy and Fairness in Federated Learning: on the Perspective of Trade-off

AI Fairness: from Principles to Practice

Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approaches

The invisible power of fairness. How machine learning shapes democracy