Abstract:As a means of decentralized machine learning, federated learning (FL) has recently drawn considerable attentions. One of the prominent advantages of FL is its capability of preventing clients' data from being directly exposed to external adversaries. Nevertheless, via a viewpoint of information theory, it is still possible for an attacker to steal private information from eavesdropping upon the shared models uploaded by FL clients. In order to address this problem, we develop a novel privacy preserving FL framework based on the concept of differential privacy (DP). To be specific, we first borrow the concept of local DP and introduce a client-level DP (CDP) by adding artificial noises to the shared models before uploading them to servers. Then, we prove that our proposed CDP algorithm can satisfy the DP guarantee with adjustable privacy protection levels by varying the variances of the artificial noises. More importantly, we derive a theoretical convergence upper-bound of the CDP algorithm. Our derived upper-bound reveals that there exists an optimal number of communication rounds to achieve the best convergence performance in terms of loss function values for a given privacy protection level. Furthermore, to obtain this optimal number of communication rounds, which cannot be derived in a closed-form expression, we propose a communication rounds discounting (CRD) method. Compared with the heuristic searching method, our proposed CRD can achieve a much better trade-off between the computational complexity of searching for the optimal number and the convergence performance. Extensive experiments indicate that our CDP algorithm with an optimization on the number of communication rounds using the proposed CRD can effectively improve both the FL training efficiency and FL model quality for a given privacy protection level.

Privacy Preserved Federated Learning for Online Ranking System (OLTR) for 6G Internet Technology

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Privacy-Preserving AI Framework for 6G-Enabled Consumer Electronics

Practical and Robust Federated Learning With Highly Scalable Regression Training

Privacy-Preserving Federated Learning for Data Heterogeneity in 6G Mobile Networks

Hybrid Differential Privacy Based Federated Learning for Internet of Things

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

Privacy-Preserving and Robust Federated Deep Metric Learning

Privacy-Preserving Distributed Learning Framework for 6G Telecom Ecosystems

Optimization Design for Federated Learning in Heterogeneous 6G Networks

Enhancing Privacy in Federated Learning through Local Training

Aldp-fl: an adaptive local differential privacy-based federated learning mechanism for IoT

A Study of Federated Learning with Internet of Things for Data Privacy and Security using Privacy Preserving Techniques

Privacy-Preserving Federated Learning for Internet of Medical Things Under Edge Computing

PPFed: A Privacy-Preserving and Personalized Federated Learning Framework

Privacy-Preserving Federated Learning with Differentially Private Hyperdimensional Computing

Clients Collaborate: Flexible Differentially Private Federated Learning with Guaranteed Improvement of Utility-Privacy Trade-off

A Novel Federated Learning Framework Based on Conditional Generative Adversarial Networks for Privacy Preserving in 6G

Exploring Homomorphic Encryption and Differential Privacy Techniques towards Secure Federated Learning Paradigm

PrivFL: Practical Privacy-preserving Federated Regressions on High-dimensional Data over Mobile Networks

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme