Abstract:Federated learning (FL) is a framework for training machine learning models in a distributed and collaborative manner. During training, a set of participating clients process their data stored locally, sharing only updates of the statistical model's parameters obtained by minimizing a cost function over their local inputs. FL was proposed as a stepping-stone towards privacy-preserving machine learning, but it has been shown to expose clients to issues such as leakage of private information, lack of personalization of the model, and the possibility of having a trained model that is fairer to some groups of clients than to others. In this paper, the focus is on addressing the triadic interaction among personalization, privacy guarantees, and fairness attained by trained models within the FL framework. Differential privacy and its variants have been studied and applied as cutting-edge standards for providing formal privacy guarantees. However, clients in FL often hold very diverse datasets representing heterogeneous communities, making it important to protect their sensitive and personal information while still ensuring that the trained model upholds the aspect of fairness for the users. To attain this objective, a method is put forth that introduces group privacy assurances through the utilization of d -privacy (aka metric privacy). d -privacy represents a localized form of differential privacy that relies on a metric-oriented obfuscation approach to maintain the original data's topological distribution. This method, besides enabling personalized model training in a federated approach and providing formal privacy guarantees, possesses significantly better group fairness measured under a variety of standard metrics than a global model trained within a classical FL template. Theoretical justifications for the applicability are provided, as well as experimental validation on real-world datasets to illustrate the working of the proposed method.

Federated Learning and Differential Privacy: Software tools analysis, the Sherpa.ai FL framework and methodological guidelines for preserving data privacy

Federated Transfer Learning with Differential Privacy

Using Decentralized Aggregation for Federated Learning with Differential Privacy

Federated Learning with Differential Privacy

Belt and Braces: When Federated Learning Meets Differential Privacy

Advancing Personalized Federated Learning: Group Privacy, Fairness, and Beyond

Belt and Brace: When Federated Learning Meets Differential Privacy

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Fair Differentially Private Federated Learning Framework

Federated Learning Privacy: Attacks, Defenses, Applications, and Policy Landscape - A Survey

Differentially Private Federated Learning: A Systematic Review

Advancements of federated learning towards privacy preservation: from federated learning to split learning

Federated Learning Meets Fairness and Differential Privacy

A Tutorial on Federated Learning from Theory to Practice: Foundations, Software Frameworks, Exemplary Use Cases, and Selected Trends

Federated f-Differential Privacy

DPFedBank: Crafting a Privacy-Preserving Federated Learning Framework for Financial Institutions with Policy Pillars

Efficient federated learning privacy preservation method with heterogeneous differential privacy

Differential Privacy Meets Federated Learning under Communication Constraints

Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning

A Multivocal Literature Review on Privacy and Fairness in Federated Learning