Abstract:Federated Learning (FL) is nowadays one of the most promising paradigms for privacy-preserving distributed learning. Without revealing its local private data to outsiders, a client in FL systems collaborates to build a global Deep Neural Network (DNN) by submitting its local model parameter update to a central server for iterative aggregation. With secure multi-party computation protocols, the submitted update of any client is also by design invisible to the server. Seemingly, this standard design is a win-win for client privacy and service provider utility. Ironically, any attacker may also use manipulated or impersonated client to submit almost any attack payloads under the umbrella of the FL protocol itself. In this work, we craft a practical backdoor attack on FL systems that is proved to be simultaneously effective and stealthy on diverse use cases of FL systems and leading commercial FL platforms in the real world. Basically, we first identify a small number of redundant neurons which tend to be rarely or slightly updated in the model, and then inject backdoor into these redundant neurons instead of the whole model. In this way, our backdoor attack can achieve a high attack success rate with a minor impact on the accuracy of the original task. As countermeasures, we further consider several common technical choices including robust aggregation mechanisms, differential privacy mechanism,s and network pruning. However, none of the defenses show desirable defense capability against our backdoor attack. Our results strongly highlight the vulnerability of existing FL systems against backdoor attacks and the urgent need to develop more effective defense mechanisms.

An Adaptive Robust Defending Algorithm Against Backdoor Attacks in Federated Learning

Backdoor Attacks and Defenses in Federated Learning: State-of-the-Art, Taxonomy, and Future Directions

RFLBAT: A Robust Federated Learning Algorithm against Backdoor Attack

RoPE: Defending against backdoor attacks in federated learning systems

CRFL: Certifiably Robust Federated Learning against Backdoor Attacks

A Robust Defense Algorithm for Backdoor Erasure Based on Attention Alignment in Federated Learning

Defending against Backdoors in Federated Learning with Robust Learning Rate

Revisiting Personalized Federated Learning: Robustness Against Backdoor Attacks

Fedward: Flexible Federated Backdoor Defense Framework with Non-IID Data

Robust Federated Learning with Adaptable Learning Rate

Towards Practical Backdoor Attacks on Federated Learning Systems

On the Vulnerability of Backdoor Defenses for Federated Learning

Never Too Late: Tracing and Mitigating Backdoor Attacks in Federated Learning

Mitigating Backdoors in Federated Learning with FLD

FLMAAcBD: Defending against backdoors in Federated Learning via Model Anomalous Activation Behavior Detection

RoPe-Door: Towards Robust and Persistent Backdoor Data Poisoning Attacks in Federated Learning

Efficient and Secure Federated Learning Against Backdoor Attacks

Act in Collusion: A Persistent Distributed Multi-Target Backdoor in Federated Learning

SCFL: Mitigating Backdoor Attacks in Federated Learning Based on SVD and Clustering.

Backdoor Defense in Federated Learning Using Differential Testing and Outlier Detection

Identifying Backdoor Attacks in Federated Learning via Anomaly Detection