Abstract:Federated learning (FL) is a promising privacy-preserving distributed machine learning methodology that allows multiple clients (i.e., workers) to collaboratively train statistical models without disclosing private training data. Due to the characteristics of data remaining localized and the uninspected on-device training process, there may exist Byzantine workers launching data poisoning and model poisoning attacks, which would seriously deteriorate model performance or prevent the model from convergence. Most of the existing Byzantine-robust FL schemes are either ineffective against several advanced poisoning attacks or need to centralize a public validation dataset, which is intractable in FL. Moreover, to the best of our knowledge, none of the existing Byzantine-robust distributed learning methods could well exert its power in Non-Independent and Identically distributed (Non-IID) data among clients. To address these issues, we propose FedCom, a novel Byzantine-robust federated learning framework by incorporating the idea of commitment from cryptography, which could achieve both data poisoning and model poisoning tolerant FL under practical Non-IID data partitions. Specifically, in FedCom, each client is first required to make a commitment to its local training data distribution. Then, we identify poisoned datasets by comparing the Wasserstein distance among commitments submitted by different clients. Furthermore, we distinguish abnormal local model updates from benign ones by testing each local model's behavior on its corresponding data commitment. We conduct an extensive performance evaluation of FedCom. The results demonstrate its effectiveness and superior performance compared to the state-of-the-art Byzantine-robust schemes in defending against typical data poisoning and model poisoning attacks under practical Non-IID data distributions.

Byzantine-Robust Compressed and Momentum-based Variance Reduction in Federated Learning

Byzantine-Robust and Communication-Efficient Distributed Learning via Compressed Momentum Filtering

Asynchronous Byzantine-Robust Stochastic Aggregation with Variance Reduction for Distributed Learning

Secure Federated Learning with Model Compression.

Secure Federated Learning over Wireless Communication Networks with Model Compression

Communication-Efficient and Byzantine-Robust Distributed Stochastic Learning with Arbitrary Number of Corrupted Workers

Robust Federated Learning: Maximum Correntropy Aggregation Against Byzantine Attacks

FedCom: A Byzantine-Robust Local Model Aggregation Rule Using Data Commitment for Federated Learning

Communication Compression for Byzantine Robust Learning: New Efficient Algorithms and Improved Rates

Federated Learning Robust to Byzantine Attacks: Achieving Zero Optimality Gap

Byzantine-Robust Federated Learning with Variance Reduction and Differential Privacy

Byzantine-Resilient Decentralized Collaborative Learning.

Byzantine-Resilient Federated Learning at Edge

Decentralized Federated Learning under Communication Delays.

Efficient Byzantine-Robust and Privacy-Preserving Federated Learning on Compressive Domain

Resilient Federated Learning under Byzantine Attack in Distributed Nonconvex Optimization with 2-f Redundancy

Understanding Byzantine Robustness in Federated Learning with A Black-box Server

A Four-Pronged Defense Against Byzantine Attacks in Federated Learning

Byzantine-resilient Federated Learning With Adaptivity to Data Heterogeneity

Over-The-Air Federated Learning under Byzantine Attacks

Momentum Benefits Non-iid Federated Learning Simply and Provably