Abstract:Federated learning (FL) has emerged to break data-silo and protect clients' privacy in the field of artificial intelligence. However, deep leakage from gradient (DLG) attack can fully reconstruct clients' data from the submitted gradient, which threatens the fundamental privacy of FL. Although cryptology and differential privacy prevent privacy leakage from gradient, they bring negative effect on communication overhead or model performance. Moreover, the original distribution of local gradient has been changed in these schemes, which makes it difficult to defend against adversarial attack. In this paper, we propose a novel federated learning framework with model decomposition, aggregation and assembling (FedDAA), along with a training algorithm, to train federated model, where local gradient is decomposed into multiple blocks and sent to different proxy servers to complete aggregation. To bring better privacy protection performance to FedDAA, an indicator is designed based on image structural similarity to measure privacy leakage under DLG attack and an optimization method is given to protect privacy with the least proxy servers. In addition, we give defense schemes against adversarial attack in FedDAA and design an algorithm to verify the correctness of aggregated results. Experimental results demonstrate that FedDAA can reduce the structural similarity between the reconstructed image and the original image to 0.014 and remain model convergence accuracy as 0.952, thus having the best privacy protection performance and model training effect. More importantly, defense schemes against adversarial attack are compatible with privacy protection in FedDAA and the defense effects are not weaker than those in the traditional FL. Moreover, verification algorithm of aggregation results brings about negligible overhead to FedDAA.

Defending against gradient inversion attacks in federated learning via statistical machine unlearning

Gradients Stand-in for Defending Deep Leakage in Federated Learning

A New Federated Learning Framework Against Gradient Inversion Attacks

Optimal Defenses Against Gradient Reconstruction Attacks

FL-AGN: A Privacy-Enhanced Federated Learning Method Based on Adaptive Gaussian Noise for Resisting Gradient Inference Attacks

Federated Learning under Attack: Improving Gradient Inversion for Batch of Images

Personalized and privacy-enhanced federated learning framework via knowledge distillation

GI-SMN: Gradient Inversion Attack against Federated Learning without Prior Knowledge

Evaluating Gradient Inversion Attacks and Defenses in Federated Learning

Gradient Leakage Defense with Key-Lock Module for Federated Learning

A Framework for Evaluating Gradient Leakage Attacks in Federated Learning

Dealing Doubt: Unveiling Threat Models in Gradient Inversion Attacks under Federated Learning, A Survey and Taxonomy

Defense Against Gradient Leakage Attacks via Learning to Obscure Data

Concealing Sensitive Samples against Gradient Leakage in Federated Learning

Robust Federated Learning Mitigates Client-side Training Data Distribution Inference Attacks

Provable Defense against Privacy Leakage in Federated Learning from Representation Perspective

EGIA: an External Gradient Inversion Attack in Federated Learning.

Hidden Data Privacy Breaches in Federated Learning

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

Defending Against Data Reconstruction Attacks in Federated Learning: An Information Theory Approach

Client-Side Gradient Inversion Attack in Federated Learning Using Secure Aggregation