Abstract:Federated Learning (FL) has emerged as a powerful paradigm for training Machine Learning (ML), particularly Deep Learning (DL) models on multiple devices or servers while maintaining data localized at owners' sites. Without centralizing data, FL holds promise for scenarios where data integrity, privacy and security and are critical. However, this decentralized training process also opens up new avenues for opponents to launch unique attacks, where it has been becoming an urgent need to understand the vulnerabilities and corresponding defense mechanisms from a learning algorithm perspective. This review paper takes a comprehensive look at malicious attacks against FL, categorizing them from new perspectives on attack origins and targets, and providing insights into their methodology and impact. In this survey, we focus on threat models targeting the learning process of FL systems. Based on the source and target of the attack, we categorize existing threat models into four types, Data to Model (D2M), Model to Data (M2D), Model to Model (M2M) and composite attacks. For each attack type, we discuss the defense strategies proposed, highlighting their effectiveness, assumptions and potential areas for improvement. Defense strategies have evolved from using a singular metric to excluding malicious clients, to employing a multifaceted approach examining client models at various phases. In this survey paper, our research indicates that the to-learn data, the learning gradients, and the learned model at different stages all can be manipulated to initiate malicious attacks that range from undermining model performance, reconstructing private local data, and to inserting backdoors. We have also seen these threat are becoming more insidious. While earlier studies typically amplified malicious gradients, recent endeavors subtly alter the least significant weights in local models to bypass defense measures. This literature review provides a holistic understanding of the current FL threat landscape and highlights the importance of developing robust, efficient, and privacy-preserving defenses to ensure the safe and trusted adoption of FL in real-world applications. The categorized bibliography can be found at: https://github.com/Rand2AI/Awesome-Vulnerability-of-Federated-Learning .

Federated Learning Under Attack: Exposing Vulnerabilities through Data Poisoning Attacks in Computer Networks

Backdoor Attacks and Defenses in Federated Learning: State-of-the-Art, Taxonomy, and Future Directions

Data Poisoning Attacks Against Federated Learning Systems

Federated Learning in Adversarial Environments: Testbed Design and Poisoning Resilience in Cybersecurity

Network-Level Adversaries in Federated Learning

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

FDSFL: Filtering Defense Strategies Toward Targeted Poisoning Attacks in IIoT-Based Federated Learning Networking System.

Data Poisoning Attacks on Federated Machine Learning

A federated learning attack method based on edge collaboration via cloud

Low Dimensional Secure Federated Learning Framework Against Poisoning Attacks

A Survey on Federated Learning Poisoning Attacks and Defenses

Learning to Attack Federated Learning: A Model-based Reinforcement Learning Attack Framework

Clean-label Poisoning Attacks on Federated Learning for IoT

FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attacks

Depriving the Survival Space of Adversaries Against Poisoned Gradients in Federated Learning

Federated Learning Attack Surface: Taxonomy, Cyber Defences, Challenges, and Future Directions

A survey on vulnerability of federated learning: A learning algorithm perspective

Challenges and Countermeasures of Federated Learning Data Poisoning Attack Situation Prediction

FedTruth: Byzantine-Robust and Backdoor-Resilient Federated Learning Framework

Deep Model Poisoning Attack on Federated Learning

Federated Learning: Balancing the Thin Line Between Data Intelligence and Privacy