Abstract:Federated learning (FL) has demonstrated tremendous success in various mission-critical large-scale scenarios. However, such promising distributed learning paradigm is still vulnerable to privacy inference and byzantine attacks. The former aims to infer the privacy of target participants involved in training, while the latter focuses on destroying the integrity of the constructed model. To mitigate the above two issues, a few works recently explored unified solutions by utilizing generic secure computation techniques and common byzantine-robust aggregation rules, but there are two major limitations: 1) they suffer from impracticality due to efficiency bottlenecks, and 2) they are still vulnerable to various types of attacks because of model incomprehensiveness. To approach the above problems, in this paper, we present SecureFL, an efficient, private and byzantine-robust FL framework. SecureFL follows the state-of-the-art byzantine-robust FL method (FLTrust NDSS’21), which performs comprehensive byzantine defense by normalizing the updates’ magnitude and measuring directional similarity, adapting it to the privacy-preserving context. More importantly, we carefully customize a series of cryptographic components. First, we design a crypto-friendly validity checking protocol that functionally replaces the normalization operation in FLTrust, and further devise tailored cryptographic protocols on top of it. Benefiting from the above optimizations, the communication and computation costs are reduced by half without sacrificing the robustness and privacy protection. Second, we develop a novel preprocessing technique for costly matrix multiplication. With this technique, the directional similarity measurement can be evaluated securely with negligible computation overhead and zero communication cost. Extensive evaluations conducted on three real-world datasets and various neural network architectures demonstrate that SecureFL outperforms prior art up to two orders of magnitude in efficiency with state-of-the-art byzantine robustness.

Defense Against Reconstruction Attacks in Split Federated Learning Through Decreasing Correlation Between Inputs and Activations.

ResSFL: A Resistance Transfer Framework for Defending Model Inversion Attack in Split Federated Learning

Passive Inference Attacks on Split Learning via Adversarial Regularization

Hidden Data Privacy Breaches in Federated Learning

Model Extraction Attacks on Split Federated Learning

Defending against Reconstruction Attack in Vertical Federated Learning

Provable Defense against Privacy Leakage in Federated Learning from Representation Perspective

Efficient, Private and Robust Federated Learning

A Stealthy Wrongdoer: Feature-Oriented Reconstruction Attack against Split Learning

Split Aggregation: Lightweight Privacy-Preserving Federated Learning Resistant to Byzantine Attacks

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Fed-Credit: Robust Federated Learning with Credibility Management

Make Split, not Hijack: Preventing Feature-Space Hijacking Attacks in Split Learning

FLIP: A Provable Defense Framework for Backdoor Mitigation in Federated Learning

Privacy-Preserving Federated Learning on Partitioned Attributes

Practical Attribute Reconstruction Attack Against Federated Learning

Secure Split Learning Against Property Inference, Data Reconstruction, and Feature Space Hijacking Attacks

Privacy Attack in Federated Learning is Not Easy: An Experimental Study

Towards Practical Backdoor Attacks on Federated Learning Systems

SIREN + : Robust Federated Learning with Proactive Alarming and Differential Privacy

Accuracy-Privacy Trade-off in the Mitigation of Membership Inference Attack in Federated Learning