Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

Efficient and Secure Federated Learning Against Backdoor Attacks

Towards Practical Backdoor Attacks on Federated Learning Systems

Privacy-Enhancing and Robust Backdoor Defense for Federated Learning on Heterogeneous Data

LDP-Fed+: A robust and privacy-preserving federated learning based classification framework enabled by local differential privacy

Compressed Federated Learning Based on Adaptive Local Differential Privacy.

A Robust Defense Algorithm for Backdoor Erasure Based on Attention Alignment in Federated Learning

Never Too Late: Tracing and Mitigating Backdoor Attacks in Federated Learning

Mitigating Backdoors in Federated Learning with FLD

Efficient, Private and Robust Federated Learning

Defending against Backdoors in Federated Learning with Robust Learning Rate

Securing Federated Learning: A Covert Communication-based Approach

Idp-Fl: A Fine-Grained and Privacy-Aware Federated Learning Framework for Deep Neural Networks

DarkFed: A Data-Free Backdoor Attack in Federated Learning

Backdoor Defense in Federated Learning Using Differential Testing and Outlier Detection

Against Backdoor Attacks in Federated Learning with Differential Privacy

Non-Cooperative Backdoor Attacks in Federated Learning: A New Threat Landscape

Efficient DP-FL: Efficient Differential Privacy Federated Learning Based on Early Stopping Mechanism

Privacy-Preserving and Reliable Decentralized Federated Learning

On the Vulnerability of Backdoor Defenses for Federated Learning

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

ESMFL: Efficient and Secure Models for Federated Learning