Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

Evaluating and Enhancing the Robustness of Federated Learning System Against Realistic Data Corruption

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Adaptive Selection of Loss Function for Federated Learning Clients Under Adversarial Attacks

Efficient, Private and Robust Federated Learning

FedCAP: Robust Federated Learning via Customized Aggregation and Personalization

Fed-Credit: Robust Federated Learning with Credibility Management

FedCom: A Byzantine-Robust Local Model Aggregation Rule Using Data Commitment for Federated Learning

Byzantine detection for federated learning under highly non-IID data and majority corruptions

Robust Federated Learning against both Data Heterogeneity and Poisoning Attack via Aggregation Optimization

Fair and Robust Federated Learning via Decentralized and Adaptive Aggregation based on Blockchain

Delving into the Adversarial Robustness of Federated Learning

Towards Understanding Adversarial Transferability in Federated Learning

Federated Robustness Propagation: Sharing Adversarial Robustness in Heterogeneous Federated Learning

Byzantine Fault-Tolerant Federated Learning Based on Trustworthy Data and Historical Information

FedTruth: Byzantine-Robust and Backdoor-Resilient Federated Learning Framework

Shielding Federated Learning: Robust Aggregation with Adaptive Client Selection

FL-WBC: Enhancing Robustness against Model Poisoning Attacks in Federated Learning from a Client Perspective

Federated Learning With Unreliable Clients: Performance Analysis and Mechanism Design

TDFL: Truth Discovery Based Byzantine Robust Federated Learning

Privacy and Robustness in Federated Learning: Attacks and Defenses

A federated learning attack method based on edge collaboration via cloud