Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

Split Aggregation: Lightweight Privacy-Preserving Federated Learning Resistant to Byzantine Attacks

Lightweight Byzantine-Robust and Privacy-Preserving Federated Learning.

Robust and Verifiable Privacy Federated Learning

RFLPA: A Robust Federated Learning Framework against Poisoning Attacks with Secure Aggregation

Two-Phase Sparsification with Secure Aggregation for Privacy-Aware Federated Learning

A Secure and Lightweight Aggregation Method for Blockchain-based Distributed Federated Learning

Secure Weighted Aggregation for Federated Learning

APFed: Anti-Poisoning Attacks in Privacy-Preserving Heterogeneous Federated Learning.

Efficient Vertical Federated Learning with Secure Aggregation

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning

AegisFL: Efficient and Flexible Privacy-Preserving Byzantine-Robust Cross-silo Federated Learning

Efficient, Private and Robust Federated Learning

Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

Efficient and Privacy-Preserving Federated Learning Against Poisoning Adversaries

FedRDF: A Robust and Dynamic Aggregation Function against Poisoning Attacks in Federated Learning

PPBR-FL: A Privacy-Preserving and Byzantine-Robust Federated Learning System.

Fast Secure Aggregation with High Dropout Resilience for Federated Learning

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

Secure and Efficient Multi-Key Aggregation for Federated Learning

FheFL: Fully Homomorphic Encryption Friendly Privacy-Preserving Federated Learning with Byzantine Users