Abstract:Federated learning (FL) has emerged to break data-silo and protect clients' privacy in the field of artificial intelligence. However, deep leakage from gradient (DLG) attack can fully reconstruct clients' data from the submitted gradient, which threatens the fundamental privacy of FL. Although cryptology and differential privacy prevent privacy leakage from gradient, they bring negative effect on communication overhead or model performance. Moreover, the original distribution of local gradient has been changed in these schemes, which makes it difficult to defend against adversarial attack. In this paper, we propose a novel federated learning framework with model decomposition, aggregation and assembling (FedDAA), along with a training algorithm, to train federated model, where local gradient is decomposed into multiple blocks and sent to different proxy servers to complete aggregation. To bring better privacy protection performance to FedDAA, an indicator is designed based on image structural similarity to measure privacy leakage under DLG attack and an optimization method is given to protect privacy with the least proxy servers. In addition, we give defense schemes against adversarial attack in FedDAA and design an algorithm to verify the correctness of aggregated results. Experimental results demonstrate that FedDAA can reduce the structural similarity between the reconstructed image and the original image to 0.014 and remain model convergence accuracy as 0.952, thus having the best privacy protection performance and model training effect. More importantly, defense schemes against adversarial attack are compatible with privacy protection in FedDAA and the defense effects are not weaker than those in the traditional FL. Moreover, verification algorithm of aggregation results brings about negligible overhead to FedDAA.

DegaFL: Decentralized Gradient Aggregation for Cross-silo Federated Learning

DeFL: Decentralized Weight Aggregation for Cross-silo Federated Learning

EVFL: Towards Efficient Verifiable Federated Learning Via Parameter Reuse and Adaptive Sparsification

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Lazy Aggregation for Heterogeneous Federated Learning

BlockDFL: A Blockchain-based Fully Decentralized Peer-to-Peer Federated Learning Framework

Decentralized Federated Learning under Communication Delays.

FedAgg: Adaptive Federated Learning with Aggregated Gradients

Gradients Stand-in for Defending Deep Leakage in Federated Learning

A Blockchain Based Decentralized Gradient Aggregation Design for Federated Learning

A Secure and Lightweight Aggregation Method for Blockchain-based Distributed Federated Learning

Encoded Gradients Aggregation against Gradient Leakage in Federated Learning

Decentralized Federated Learning: Balancing Communication and Computing Costs

Byzantine-Robust Aggregation for Securing Decentralized Federated Learning

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

Split Aggregation: Lightweight Privacy-Preserving Federated Learning Resistant to Byzantine Attacks

Flagger: Cooperative Acceleration for Large-Scale Cross-Silo Federated Learning Aggregation

zkFL: Zero-Knowledge Proof-based Gradient Aggregation for Federated Learning

Federated Learning with Unbiased Gradient Aggregation and Controllable Meta Updating

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection