Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

A Privacy Preserving and Byzantine Robust Collaborative Federated Learning Method Design

Decentralized Iot Data Sharing: A Blockchain-Based Federated Learning Approach with Joint Optimizations for Efficiency and Privacy

CFL: Cluster Federated Learning in Large-scale Peer-to-Peer Networks

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Decentralized P2P Federated Learning for Privacy-Preserving and Resilient Mobile Robotic Systems

Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

Trading Trust for Privacy: Socially-Motivated Personalized Privacy-Preserving Collaborative Learning in IoT

Wireless Communications for Collaborative Federated Learning

Securing Federated Learning: A Covert Communication-based Approach

Lightweight Byzantine-Robust and Privacy-Preserving Federated Learning.

PPT: A Privacy-Preserving Global Model Training Protocol for Federated Learning in P2P Networks

Efficient Byzantine-Robust and Provably Privacy-Preserving Federated Learning

An Improved Federated Learning Algorithm for Privacy Preserving in Cybertwin-Driven 6G System

A flexible and privacy-preserving federated learning framework based on logistic regression

PPCL: Privacy-preserving collaborative learning for mitigating indirect information leakage

Efficient, Private and Robust Federated Learning

Privacy-Preserving Federated Class-Incremental Learning

A Novel Federated Learning Framework Based on Conditional Generative Adversarial Networks for Privacy Preserving in 6G

Trading Off Privacy, Utility and Efficiency in Federated Learning

Bold but Cautious: Unlocking the Potential of Personalized Federated Learning through Cautiously Aggressive Collaboration

BSR-FL: an Efficient Byzantine-Robust Privacy-Preserving Federated Learning Framework