Abstract:A key feature of federated learning (FL) is to preserve the data privacy of end users. However, there still exist potential privacy leakage in exchanging gradients under FL. As a result, recent research often explores the differential privacy (DP) approaches to add noises to the computing results to address privacy concerns with low overheads, which however degrade the model performance. In this paper, we strike the balance of data privacy and efficiency by utilizing the pervasive social connections between users. Specifically, we propose SCFL, a novel Social-aware Clustered Federated Learning scheme, where mutually trusted individuals can freely form a social cluster and aggregate their raw model updates (e.g., gradients) inside each cluster before uploading to the cloud for global aggregation. By mixing model updates in a social group, adversaries can only eavesdrop the social-layer combined results, but not the privacy of individuals. As such, SCFL considerably enhances model utility without sacrificing privacy in a low-cost and highly feasible manner. We unfold the design of SCFL in three steps. i) Stable social cluster formation. Considering users' heterogeneous training samples and data distributions, we formulate the optimal social cluster formation problem as a federation game and devise a fair revenue allocation mechanism to resist free-riders. ii) Differentiated trust-privacy mapping. For the clusters with low mutual trust, we design a customizable privacy preservation mechanism to adaptively sanitize participants' model updates depending on social trust degrees. iii) Distributed convergence. A distributed two-sided matching algorithm is devised to attain an optimized disjoint partition with Nash-stable convergence. Experiments on Facebook network and MNIST/CIFAR-10 datasets validate that our SCFL can effectively enhance learning utility, improve user payoff, and enforce customizable privacy protection.

CLFLDP: Communication-efficient layer clipping federated learning with local differential privacy

HFL-DP: Hierarchical Federated Learning with Differential Privacy

LLDP: A Layer-wise Local Differential Privacy in Federated Learning.

GFL-ALDPA: a gradient compression federated learning framework based on adaptive local differential privacy budget allocation

FLCP: federated learning framework with communication-efficient and privacy-preserving

AdaDP-CFL: Cluster Federated Learning with Adaptive Clipping Threshold Differential Privacy

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

Joint Communication and Learning Design of Differential Privacy for Federated Learning over Multi-cell Networks.

LDP-Fed+: A robust and privacy-preserving federated learning based classification framework enabled by local differential privacy

FDP-FL: Differentially Private Federated Learning with Flexible Privacy Budget Allocation

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

A Lightweight and Accuracy-Lossless Privacy-Preserving Method in Federated Learning

Communication-Efficient and Privacy-Preserving Aggregation in Federated Learning With Adaptability

Differential Privacy Meets Federated Learning under Communication Constraints

Hierarchical federated learning with global differential privacy

FedFDP: Fairness-Aware Federated Learning with Differential Privacy

Social-Aware Clustered Federated Learning With Customized Privacy Preservation

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Efficient federated learning privacy preservation method with heterogeneous differential privacy

A novel local differential privacy federated learning under multi-privacy regimes