Abstract:Federated learning (FL) is a framework for training machine learning models in a distributed and collaborative manner. During training, a set of participating clients process their data stored locally, sharing only updates of the statistical model's parameters obtained by minimizing a cost function over their local inputs. FL was proposed as a stepping-stone towards privacy-preserving machine learning, but it has been shown to expose clients to issues such as leakage of private information, lack of personalization of the model, and the possibility of having a trained model that is fairer to some groups of clients than to others. In this paper, the focus is on addressing the triadic interaction among personalization, privacy guarantees, and fairness attained by trained models within the FL framework. Differential privacy and its variants have been studied and applied as cutting-edge standards for providing formal privacy guarantees. However, clients in FL often hold very diverse datasets representing heterogeneous communities, making it important to protect their sensitive and personal information while still ensuring that the trained model upholds the aspect of fairness for the users. To attain this objective, a method is put forth that introduces group privacy assurances through the utilization of d -privacy (aka metric privacy). d -privacy represents a localized form of differential privacy that relies on a metric-oriented obfuscation approach to maintain the original data's topological distribution. This method, besides enabling personalized model training in a federated approach and providing formal privacy guarantees, possesses significantly better group fairness measured under a variety of standard metrics than a global model trained within a classical FL template. Theoretical justifications for the applicability are provided, as well as experimental validation on real-world datasets to illustrate the working of the proposed method.

Generalized genomic data sharing for differentially private federated learning

Efficient federated learning privacy preservation method with heterogeneous differential privacy

DMM: Distributed Matrix Mechanism for Differentially-Private Federated Learning using Packed Secret Sharing

Federated Synthetic Data Generation with Differential Privacy

Privacy-Preserving Federated Discovery of DNA Motifs with Differential Privacy

Reproducibility-Oriented and Privacy-Preserving Genomic Dataset Sharing

Private Dataset Generation Using Privacy Preserving Collaborative Learning

Fair Differentially Private Federated Learning Framework

A privacy preserving federated learning scheme using homomorphic encryption and secret sharing

Privacy-preserving Heterogeneous Federated Transfer Learning.

Privacy preserving distributed machine learning with federated learning

Investigating privacy-preserving machine learning for healthcare data sharing through federated learning

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

GenShare: Sharing Accurate Differentially-Private Statistics for Genomic Datasets with Dependent Tuples

ALI-DPFL: Differentially Private Federated Learning with Adaptive Local Iterations

GFL-ALDPA: a gradient compression federated learning framework based on adaptive local differential privacy budget allocation

Advancing Personalized Federated Learning: Group Privacy, Fairness, and Beyond

Differentially Private Federated Learning with an Adaptive Noise Mechanism

Private FL-GAN: Differential Privacy Synthetic Data Generation Based on Federated Learning.

Privacy-preserving gradient-based fair federated learning

FedFDP: Fairness-Aware Federated Learning with Differential Privacy