Abstract:Data poisoning and leakage risks impede the massive deployment of federated learning in the real world. This chapter reveals the truths and pitfalls of understanding two dominating threats: {\em training data privacy intrusion} and {\em training data poisoning}. We first investigate training data privacy threat and present our observations on when and how training data may be leaked during the course of federated training. One promising defense strategy is to perturb the raw gradient update by adding some controlled randomized noise prior to sharing during each round of federated learning. We discuss the importance of determining the proper amount of randomized noise and the proper location to add such noise for effective mitigation of gradient leakage threats against training data privacy. Then we will review and compare different training data poisoning threats and analyze why and when such data poisoning induced model Trojan attacks may lead to detrimental damage on the performance of the global model. We will categorize and compare representative poisoning attacks and the effectiveness of their mitigation techniques, delivering an in-depth understanding of the negative impact of data poisoning. Finally, we demonstrate the potential of dynamic model perturbation in simultaneously ensuring privacy protection, poisoning resilience, and model performance. The chapter concludes with a discussion on additional risk factors in federated learning, including the negative impact of skewness, data and algorithmic biases, as well as misinformation in training data. Powered by empirical evidence, our analytical study offers some transformative insights into effective privacy protection and security assurance strategies in attack-resilient federated learning.

Pocket Diagnosis: Secure Federated Learning against Poisoning Attack in the Cloud

A Survey on Federated Learning Poisoning Attacks and Defenses

Challenges and Countermeasures of Federated Learning Data Poisoning Attack Situation Prediction

DPFLA: Defending Private Federated Learning Against Poisoning Attacks

ADFL: A Poisoning Attack Defense Framework for Horizontal Federated Learning

FL-PTD: A Privacy Preserving Defense Strategy Against Poisoning Attacks in Federated Learning.

Efficiently Achieving Privacy Preservation and Poisoning Attack Resistance in Federated Learning

Low Dimensional Secure Federated Learning Framework Against Poisoning Attacks

Poisoning Attacks in Federated Learning: A Survey

Federated Learning: Balancing the Thin Line Between Data Intelligence and Privacy

SPFL: A Self-purified Federated Learning Method Against Poisoning Attacks

Detecting Data Poisoning Attacks in Federated Learning for Healthcare Applications Using Deep Learning

Defending Against Data Poisoning Attack in Federated Learning With Non-IID Data

RFed: Robustness-Enhanced Privacy-Preserving Federated Learning Against Poisoning Attack

RFLPA: A Robust Federated Learning Framework against Poisoning Attacks with Secure Aggregation

Fed-LSAE: Thwarting Poisoning Attacks against Federated Cyber Threat Detection System via Autoencoder-based Latent Space Inspection

Defending Poisoning Attacks in Federated Learning via Adversarial Training Method

Poisoning Prevention in Federated Learning and Differential Privacy via Stateful Proofs of Execution

Data Poisoning and Leakage Analysis in Federated Learning

ApaPRFL: Robust Privacy-Preserving Federated Learning Scheme Against Poisoning Adversaries for Intelligent Devices Using Edge Computing