Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

FLBooster: A Unified and Efficient Platform for Federated Learning Acceleration.

QFL: Federated Learning Acceleration Based on QAT Hardware Accelerator.

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

Flagger: Cooperative Acceleration for Large-Scale Cross-Silo Federated Learning Aggregation

HAFLO: GPU-Based Acceleration for Federated Logistic Regression

FedAux: an Efficient Framework for Hybrid Federated Learning

Accelerating Federated Learning Via Parallel Servers: A Theoretically Guaranteed Approach.

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression.

Partial Synchronization to Accelerate Federated Learning over Relay-Assisted Edge Networks

Efficient Adaptive Federated Optimization of Federated Learning for IoT

Adaptive Control of Client Selection and Gradient Compression for Efficient Federated Learning

No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation.

Accelerating Federated Learning with Cluster Construction and Hierarchical Aggregation.

FedConv: A Learning-on-Model Paradigm for Heterogeneous Federated Clients

FedBalancer: Data and Pace Control for Efficient Federated Learning on Heterogeneous Clients

HyperFeel: an Efficient Federated Learning Framework Using Hyperdimensional Computing

Computation and Communication Efficient Adaptive Federated Optimization of Federated Learning for Internet of Things

Efficient, Private and Robust Federated Learning

FedEdge: Accelerating Edge-Assisted Federated Learning

AsyFed: Accelerated Federated Learning with Asynchronous Communication Mechanism

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing