Abstract:Federated learning (FL) has emerged to break data-silo and protect clients' privacy in the field of artificial intelligence. However, deep leakage from gradient (DLG) attack can fully reconstruct clients' data from the submitted gradient, which threatens the fundamental privacy of FL. Although cryptology and differential privacy prevent privacy leakage from gradient, they bring negative effect on communication overhead or model performance. Moreover, the original distribution of local gradient has been changed in these schemes, which makes it difficult to defend against adversarial attack. In this paper, we propose a novel federated learning framework with model decomposition, aggregation and assembling (FedDAA), along with a training algorithm, to train federated model, where local gradient is decomposed into multiple blocks and sent to different proxy servers to complete aggregation. To bring better privacy protection performance to FedDAA, an indicator is designed based on image structural similarity to measure privacy leakage under DLG attack and an optimization method is given to protect privacy with the least proxy servers. In addition, we give defense schemes against adversarial attack in FedDAA and design an algorithm to verify the correctness of aggregated results. Experimental results demonstrate that FedDAA can reduce the structural similarity between the reconstructed image and the original image to 0.014 and remain model convergence accuracy as 0.952, thus having the best privacy protection performance and model training effect. More importantly, defense schemes against adversarial attack are compatible with privacy protection in FedDAA and the defense effects are not weaker than those in the traditional FL. Moreover, verification algorithm of aggregation results brings about negligible overhead to FedDAA.

A Lightweight and Accuracy-Lossless Privacy-Preserving Method in Federated Learning

Towards Efficient and Privacy-Preserving Federated Deep Learning

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Dual-Server-Based Lightweight Privacy-Preserving Federated Learning

A Practical Privacy-preserving Method in Federated Deep Learning

Privacy, accuracy, and model fairness trade-offs in federated learning

Efficient federated learning privacy preservation method with heterogeneous differential privacy

CLFLDP: Communication-efficient layer clipping federated learning with local differential privacy

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

A flexible and privacy-preserving federated learning framework based on logistic regression

Client-based differential privacy federated learning

Secure Decentralized Aggregation to Prevent Membership Privacy Leakage in Edge-based Federated Learning

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

PPFed: A Privacy-Preserving and Personalized Federated Learning Framework

A New Implementation of Federated Learning for Privacy and Security Enhancement

The Impact of Differential Privacy on Model Fairness in Federated Learning.

Federated Learning with Reduced Information Leakage and Computation

LDP-Fed+: A robust and privacy-preserving federated learning based classification framework enabled by local differential privacy

A Fine-Grained Differentially Private Federated Learning Against Leakage from Gradients

GFL-ALDPA: a gradient compression federated learning framework based on adaptive local differential privacy budget allocation