Abstract:In the realm of federated learning (FL), the exchange of model data may inadvertently expose sensitive information of participants, leading to significant privacy concerns. Existing FL privacy-preserving techniques, such as differential privacy (DP) and secure multi-party computing (SMC), though offering viable solutions, face practical challenges including reduced performance and complex implementations. To overcome these hurdles, we propose a novel and pragmatic approach to privacy preservation in FL by employing localized federated updates (LF3PFL) aimed at enhancing the protection of participant data. Furthermore, this research refines the approach by incorporating cross-entropy optimization, carefully fine-tuning measurement, and improving information loss during the model training phase to enhance both model efficacy and data confidentiality. Our approach is theoretically supported and empirically validated through extensive simulations on three public datasets: CIFAR-10, Shakespeare, and MNIST. We evaluate its effectiveness by comparing training accuracy and privacy protection against state-of-the-art techniques. Our experiments, which involve five distinct local models (Simple-CNN, ModerateCNN, Lenet, VGG9, and Resnet18), provide a comprehensive assessment across a variety of scenarios. The results clearly demonstrate that LF3PFL not only maintains competitive training accuracies but also significantly improves privacy preservation, surpassing existing methods in practical applications. This balance between privacy and performance underscores the potential of localized federated updates as a key component in future FL privacy strategies, offering a scalable and effective solution to one of the most pressing challenges in FL.

Model Segmentation for Storage Efficient Private Federated Learning with Top $r$ Sparsification

Private Read-Update-Write with Controllable Information Leakage for Storage-Efficient Federated Learning with Top $r$ Sparsification

Rate-Privacy-Storage Tradeoff in Federated Learning with Top $r$ Sparsification

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Information-Theoretically Private Federated Submodel Learning with Storage Constrained Databases

Efficient Model Compression via Global Sparsification for Over-the-Air Federated Learning.

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

A Novel Privacy Enhancement Scheme with Dynamic Quantization for Federated Learning

Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

Sparse Federated Learning with Hierarchical Personalized Models

Secure Decentralized Aggregation to Prevent Membership Privacy Leakage in Edge-based Federated Learning

Practical Locally Private Federated Learning with Communication Efficiency

A flexible and privacy-preserving federated learning framework based on logistic regression

Communication-Efficient and Privacy-Preserving Aggregation in Federated Learning With Adaptability

Sparsified Secure Aggregation for Privacy-Preserving Federated Learning

Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

Achieving Personalized Federated Learning with Sparse Local Models

Beyond Model Splitting: Preventing Label Inference Attacks in Vertical Federated Learning with Dispersed Training

Privacy-preserving Federated Primal-dual Learning for Non-convex and Non-smooth Problems with Model Sparsification

Secure and efficient federated learning via novel multi-party computation and compressed sensing