Abstract:As applications of machine learning become increasingly widespread, the need to ensure model accuracy and fairness while protecting the privacy of user data becomes more pronounced. On this note, this paper introduces a federated learning training model, which allow clients to simultaneously learn their model and update the associated parameters on a centralized server. In our approach, we seek to achieve an acceptable trade-off between privacy, accuracy, and model fairness by using differential privacy (DP), which also helps to minimize privacy risks by protecting the presence of a specific sample in the training data. Machine learning models can, however, exhibit unintended behaviors, such as unfairness, which result in groups with certain sensitive characteristics (e.g., gender) receiving different patterns of outcomes. Hence, we discuss the fairness and privacy effect of local DP and global DP when applied to federated learning by designing a fair and privacy quantification mechanism. In doing so, we can achieve an acceptable trade-off between accuracy, privacy, and model fairness. We quantify the level of fairness based on the constraints of three definitions of fairness, including demographic parity, equal odds, and equality of opportunity. Finally, findings from our extensive experiments conducted on three real-world datasets with class imbalance demonstrate the positive effect of local and global DP on fairness. Our study also shows that privacy can come at the cost of fairness, as stricter privacy can intensify discrimination. Hence, we posit that careful parameter selection can potentially help achieve a more effective trade-off between utility, bias, and privacy.

Differential Privacy Hierarchical Federated Learning Method based on Privacy Budget Allocation

An Adaptive Differential Privacy Method Based on Federated Learning

Efficient federated learning privacy preservation method with heterogeneous differential privacy

Joint Communication and Learning Design of Differential Privacy for Federated Learning over Multi-cell Networks.

FDP-FL: Differentially Private Federated Learning with Flexible Privacy Budget Allocation

Federated learning with differential privacy via fast Fourier transform for tighter-efficient combining

Hierarchical federated learning with global differential privacy

Client-based differential privacy federated learning

GFL-ALDPA: a gradient compression federated learning framework based on adaptive local differential privacy budget allocation

Federated Transfer Learning with Differential Privacy

Differentially-Private Multi-Tier Federated Learning

Differentially Private Federated Learning with an Adaptive Noise Mechanism

The Impact of Differential Privacy on Model Fairness in Federated Learning.

A Fine-Grained Differentially Private Federated Learning Against Leakage from Gradients

Hybrid Differential Privacy Based Federated Learning for Internet of Things

SPM-FL: A Federated Learning Privacy-Protection Mechanism Based on Local Differential Privacy

Privacy As a Resource in Differentially Private Federated Learning.

AWDP-FL: An Adaptive Differential Privacy Federated Learning Framework

PT-ADP: A Personalized Privacy-Preserving Federated Learning Scheme Based on Transaction Mechanism

A Communication-Efficient, Privacy-Preserving Federated Learning Algorithm Based on Two-Stage Gradient Pruning and Differentiated Differential Privacy

Privacy, accuracy, and model fairness trade-offs in federated learning