Abstract:Federated learning (FL) emerged as a paradigm designed to improve data privacy by enabling data to reside at its source, thus embedding privacy as a core consideration in FL architectures, whether centralized or decentralized. Contrasting with recent findings by Pasquini et al., which suggest that decentralized FL does not empirically offer any additional privacy or security benefits over centralized models, our study provides compelling evidence to the contrary. We demonstrate that decentralized FL, when deploying distributed optimization, provides enhanced privacy protection - both theoretically and empirically - compared to centralized approaches. The challenge of quantifying privacy loss through iterative processes has traditionally constrained the theoretical exploration of FL protocols. We overcome this by conducting a pioneering in-depth information-theoretical privacy analysis for both frameworks. Our analysis, considering both eavesdropping and passive adversary models, successfully establishes bounds on privacy leakage. We show information theoretically that the privacy loss in decentralized FL is upper bounded by the loss in centralized FL. Compared to the centralized case where local gradients of individual participants are directly revealed, a key distinction of optimization-based decentralized FL is that the relevant information includes differences of local gradients over successive iterations and the aggregated sum of different nodes' gradients over the network. This information complicates the adversary's attempt to infer private data. To bridge our theoretical insights with practical applications, we present detailed case studies involving logistic regression and deep neural networks. These examples demonstrate that while privacy leakage remains comparable in simpler models, complex models like deep neural networks exhibit lower privacy risks under decentralized FL.

Decentralized Online Bandit Federated Learning Over Unbalanced Directed Networks

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

BlockDFL: A Blockchain-based Fully Decentralized Peer-to-Peer Federated Learning Framework

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

Joint Communication and Learning Design of Differential Privacy for Federated Learning over Multi-cell Networks.

DP-FL: a Novel Differentially Private Federated Learning Framework for the Unbalanced Data

Provable Privacy Advantages of Decentralized Federated Learning via Distributed Optimization

Decentralized Wireless Federated Learning with Differential Privacy

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

Balancing Privacy and Performance for Private Federated Learning Algorithms

Using Decentralized Aggregation for Federated Learning with Differential Privacy

DTPP-DFL: A Dropout-Tolerated Privacy-Preserving Decentralized Federated Learning Framework

FedFDP: Fairness-Aware Federated Learning with Differential Privacy

FDP-FL: Differentially Private Federated Learning with Flexible Privacy Budget Allocation

A differential privacy federated learning framework for accelerating convergence

Differentially Private Federated Learning on Heterogeneous Data

Efficient DP-FL: Efficient Differential Privacy Federated Learning Based on Early Stopping Mechanism

Low-Latency Federated Learning over Wireless Channels with Differential Privacy

Aldp-fl: an adaptive local differential privacy-based federated learning mechanism for IoT

Enhancing Federated Learning with Adaptive Differential Privacy and Priority-Based Aggregation

Overlay-based Decentralized Federated Learning in Bandwidth-limited Networks