Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

PySyft: A Library for Easy Federated Learning

Fedlabx: a Practical and Privacy-Preserving Framework for Federated Learning

A Generalized Look at Federated Learning: Survey and Perspectives

SaFL: Sybil-aware Federated Learning with Application to Face Recognition

Federated Learning in Practice: Reflections and Projections

NVIDIA FLARE: Federated Learning from Simulation to Real-World

pfl-research: simulation framework for accelerating research in Private Federated Learning

Flotta: a Secure and Flexible Spark-inspired Federated Learning Framework

FLEX: FLEXible Federated Learning Framework

Efficient, Private and Robust Federated Learning

FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations

Federated Learning Privacy: Attacks, Defenses, Applications, and Policy Landscape - A Survey

PrivacyFL: A simulator for privacy-preserving and secure federated learning

Advances in APPFL: A Comprehensive and Extensible Federated Learning Framework

A Multifaceted Survey on Federated Learning: Fundamentals, Paradigm Shifts, Practical Issues, Recent Developments, Partnerships, Trade-Offs, Trustworthiness, and Ways Forward

Advancements of federated learning towards privacy preservation: from federated learning to split learning

XFL: A High Performace, Lightweighted Federated Learning Framework

A Tutorial on Federated Learning from Theory to Practice: Foundations, Software Frameworks, Exemplary Use Cases, and Selected Trends

A Maneuver in the Trade-Off Space of Federated Learning Aggregation Frameworks Secured with Polymorphic Encryption: PolyFLAM and PolyFLAP Frameworks

APPFLx: Providing Privacy-Preserving Cross-Silo Federated Learning as a Service

WW-FL: Secure and Private Large-Scale Federated Learning