Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

Robust Asynchronous Federated Learning with Time-weighted and Stale Model Aggregation

Asynchronous Federated Learning over Wireless Communication Networks.

AsyFed: Accelerated Federated Learning with Asynchronous Communication Mechanism

Robust Model Aggregation for Heterogeneous Federated Learning: Analysis and Optimizations

Staleness-Controlled Asynchronous Federated Learning: Accuracy and Efficiency Tradeoff

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

Privacy-Preserving Model Aggregation for Asynchronous Federated Learning

Asynchronous Byzantine Federated Learning

Integrating Staleness and Shapley Value Consistency for Efficient K-Asynchronous Federated Learning

Asynchronous Federated Learning: A Scalable Approach for Decentralized Machine Learning

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

FedASMU: Efficient Asynchronous Federated Learning with Dynamic Staleness-aware Model Update

Privacy-Preserving and Reliable Decentralized Federated Learning

AEDFL: Efficient Asynchronous Decentralized Federated Learning with Heterogeneous Devices

Towards Stagewise and Energy-Accuracy-balanced Client Selection and Resource Allocation over Dynamic Federated Learning Networks

Mitigating System Bias in Resource Constrained Asynchronous Federated Learning Systems

A Secure and Lightweight Aggregation Method for Blockchain-based Distributed Federated Learning

Privacy-Preserving Asynchronous Federated Learning Under Non-IID Settings

Secure and Efficient Federated Learning Via Novel Authenticable Multi-Party Computation and Compressed Sensing

ACCESS-FL: Agile Communication and Computation for Efficient Secure Aggregation in Stable Federated Learning Networks

Efficient, Private and Robust Federated Learning