Abstract:A key feature of federated learning (FL) is to preserve the data privacy of end users. However, there still exist potential privacy leakage in exchanging gradients under FL. As a result, recent research often explores the differential privacy (DP) approaches to add noises to the computing results to address privacy concerns with low overheads, which however degrade the model performance. In this paper, we strike the balance of data privacy and efficiency by utilizing the pervasive social connections between users. Specifically, we propose SCFL, a novel Social-aware Clustered Federated Learning scheme, where mutually trusted individuals can freely form a social cluster and aggregate their raw model updates (e.g., gradients) inside each cluster before uploading to the cloud for global aggregation. By mixing model updates in a social group, adversaries can only eavesdrop the social-layer combined results, but not the privacy of individuals. As such, SCFL considerably enhances model utility without sacrificing privacy in a low-cost and highly feasible manner. We unfold the design of SCFL in three steps. i) Stable social cluster formation. Considering users' heterogeneous training samples and data distributions, we formulate the optimal social cluster formation problem as a federation game and devise a fair revenue allocation mechanism to resist free-riders. ii) Differentiated trust-privacy mapping. For the clusters with low mutual trust, we design a customizable privacy preservation mechanism to adaptively sanitize participants' model updates depending on social trust degrees. iii) Distributed convergence. A distributed two-sided matching algorithm is devised to attain an optimized disjoint partition with Nash-stable convergence. Experiments on Facebook network and MNIST/CIFAR-10 datasets validate that our SCFL can effectively enhance learning utility, improve user payoff, and enforce customizable privacy protection.

FLea: Addressing Data Scarcity and Label Skew in Federated Learning via Privacy-preserving Feature Augmentation

Privacy-Preserving Federated Learning Against Label-Flipping Attacks on Non-IID Data

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Social-Aware Clustered Federated Learning With Customized Privacy Preservation

Privacy Vs. Efficiency: Achieving Both Through Adaptive Hierarchical Federated Learning

Personalized Federated Learning on Long-Tailed Data Via Adversarial Feature Augmentation.

FedFed: Feature Distillation Against Data Heterogeneity in Federated Learning

FedFDP: Fairness-Aware Federated Learning with Differential Privacy

FedFA: Federated Feature Augmentation

A New Implementation of Federated Learning for Privacy and Security Enhancement

Improving Federated Learning Face Recognition via Privacy-Agnostic Clusters

RAFLS: RDP-Based Adaptive Federated Learning with Shuffle Model

Secure Decentralized Aggregation to Prevent Membership Privacy Leakage in Edge-based Federated Learning

Adaptive Coded Federated Learning: Privacy Preservation and Straggler Mitigation

FRAug: Tackling Federated Learning with Non-IID Features via Representation Augmentation

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

Privacy-Enhanced Federated Learning for Non-IID Data

Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning

FLCP: federated learning framework with communication-efficient and privacy-preserving

Two-Phase Sparsification with Secure Aggregation for Privacy-Aware Federated Learning