Abstract:Federated learning (FL) emerged as a paradigm designed to improve data privacy by enabling data to reside at its source, thus embedding privacy as a core consideration in FL architectures, whether centralized or decentralized. Contrasting with recent findings by Pasquini et al., which suggest that decentralized FL does not empirically offer any additional privacy or security benefits over centralized models, our study provides compelling evidence to the contrary. We demonstrate that decentralized FL, when deploying distributed optimization, provides enhanced privacy protection - both theoretically and empirically - compared to centralized approaches. The challenge of quantifying privacy loss through iterative processes has traditionally constrained the theoretical exploration of FL protocols. We overcome this by conducting a pioneering in-depth information-theoretical privacy analysis for both frameworks. Our analysis, considering both eavesdropping and passive adversary models, successfully establishes bounds on privacy leakage. We show information theoretically that the privacy loss in decentralized FL is upper bounded by the loss in centralized FL. Compared to the centralized case where local gradients of individual participants are directly revealed, a key distinction of optimization-based decentralized FL is that the relevant information includes differences of local gradients over successive iterations and the aggregated sum of different nodes' gradients over the network. This information complicates the adversary's attempt to infer private data. To bridge our theoretical insights with practical applications, we present detailed case studies involving logistic regression and deep neural networks. These examples demonstrate that while privacy leakage remains comparable in simpler models, complex models like deep neural networks exhibit lower privacy risks under decentralized FL.

FedSteg: Coverless Steganography‐Based Privacy‐Preserving Decentralized Federated Learning

Secure Decentralized Aggregation to Prevent Membership Privacy Leakage in Edge-based Federated Learning

Towards Efficient and Privacy-Preserving Federated Deep Learning

A Stealthy Communication Model for Protecting Aggregated Results Integrity in Federated Learning

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Privacy-Enhanced Decentralized Federated Learning at Dynamic Edge

Shield Against Gradient Leakage Attacks: Adaptive Privacy-Preserving Federated Learning

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

A Privacy-Enhanced Federated Learning Scheme with Identity Protection

A New Federated Learning Framework Against Gradient Inversion Attacks

FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System

Gradients Stand-in for Defending Deep Leakage in Federated Learning

Hidden Data Privacy Breaches in Federated Learning

Concealing Sensitive Samples against Gradient Leakage in Federated Learning

Privacy-preserving gradient-based fair federated learning

Local differentially private federated learning with homomorphic encryption

Provable Privacy Advantages of Decentralized Federated Learning via Distributed Optimization

Gradient-Leakage Resilient Federated Learning

FLCP: federated learning framework with communication-efficient and privacy-preserving