Abstract:In the realm of federated learning (FL), the exchange of model data may inadvertently expose sensitive information of participants, leading to significant privacy concerns. Existing FL privacy-preserving techniques, such as differential privacy (DP) and secure multi-party computing (SMC), though offering viable solutions, face practical challenges including reduced performance and complex implementations. To overcome these hurdles, we propose a novel and pragmatic approach to privacy preservation in FL by employing localized federated updates (LF3PFL) aimed at enhancing the protection of participant data. Furthermore, this research refines the approach by incorporating cross-entropy optimization, carefully fine-tuning measurement, and improving information loss during the model training phase to enhance both model efficacy and data confidentiality. Our approach is theoretically supported and empirically validated through extensive simulations on three public datasets: CIFAR-10, Shakespeare, and MNIST. We evaluate its effectiveness by comparing training accuracy and privacy protection against state-of-the-art techniques. Our experiments, which involve five distinct local models (Simple-CNN, ModerateCNN, Lenet, VGG9, and Resnet18), provide a comprehensive assessment across a variety of scenarios. The results clearly demonstrate that LF3PFL not only maintains competitive training accuracies but also significantly improves privacy preservation, surpassing existing methods in practical applications. This balance between privacy and performance underscores the potential of localized federated updates as a key component in future FL privacy strategies, offering a scalable and effective solution to one of the most pressing challenges in FL.

Privacy-preserving Cost-sensitive Federated Learning from Imbalanced Data

Projected Federated Averaging with Heterogeneous Differential Privacy.

The Impact of Differential Privacy on Model Fairness in Federated Learning.

Privacy, accuracy, and model fairness trade-offs in federated learning

Client-based differential privacy federated learning

Efficient federated learning privacy preservation method with heterogeneous differential privacy

An Adaptive Differential Privacy Method Based on Federated Learning

Federated Transfer Learning with Differential Privacy

PPFed: A Privacy-Preserving and Personalized Federated Learning Framework

Clients Collaborate: Flexible Differentially Private Federated Learning with Guaranteed Improvement of Utility-Privacy Trade-off

Differentially private secure multi-party computation for federated learning in financial applications

Optimal Contract Design for Efficient Federated Learning with Multi-Dimensional Private Information

The Effects of Data Imbalance Under a Federated Learning Approach for Credit Risk Forecasting

Privacy-Preserving Heterogeneous Federated Learning for Sensitive Healthcare Data

Differential Privacy Hierarchical Federated Learning Method based on Privacy Budget Allocation

A Practical Privacy-preserving Method in Federated Deep Learning

Differentially Private Low-Rank Adaptation of Large Language Model Using Federated Learning

Towards Efficient and Privacy-Preserving Federated Deep Learning

Differentially Private Federated Learning with an Adaptive Noise Mechanism

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme