Abstract:In the field of Natural Language Processing (NLP), Deep Learning (DL) and Neural Network (NN) technologies have been widely applied to machine translation and sentiment analysis and have demonstrated outstanding performance. In recent years, NLP applications have also combined multimodal data, such as visual and audio, continuously improving language processing performance. At the same time, the size of Neural Network models is increasing, and many models cannot be deployed on devices with limited computing resources. Deploying models on cloud platforms has become a trend. However, deploying models in the cloud introduces new privacy risks for endpoint data, despite overcoming computational limitations. Federated Learning (FL) methods protect local data by keeping the data on the client side and only sending local updates to the central server. However, the FL architecture still has problems, such as vulnerability to adversarial attacks and non-IID data distribution. In this work, we propose a Federated Learning aggregation method called FedREAS. The server uses a benchmark dataset to train a global model and obtains benchmark updates in this method. Before aggregating local updates, the server adjusts the local updates using the benchmark updates and then returns the adjusted benchmark updates. Then, based on the similarity between the adjusted local updates and the adjusted benchmark updates, the server aggregates these local updates to obtain a more robust update. This method also improves the client selection process. FedREAS selects suitable clients for training at the beginning of each round based on specific strategies, the similarity of the previous round’s updates, and the submitted data. We conduct experiments on different datasets and compare FedREAS with other Federated Learning methods. The results show that FedREAS outperforms other methods regarding model performance and resistance to attacks.

Attack-Resistant Federated Learning with Residual-based Reweighting

Backdoor Attacks and Defenses in Federated Learning: State-of-the-Art, Taxonomy, and Future Directions

Robust Quantity-Aware Aggregation for Federated Learning

A Secure Aggregation for Federated Learning on Long-Tailed Data

Shielding Federated Learning: Robust Aggregation with Adaptive Client Selection

An Efficient and Robust Aggregation Algorithm for Learning Federated CNN.

Federated Learning Aggregation: New Robust Algorithms with Guarantees

Secure Partial Aggregation: Making FederatedLearning More Robust for Industry 4.0 Applications

Revisiting Weighted Aggregation in Federated Learning with Neural Networks

A Federated Learning Aggregation That Integrates Clustering and Momentum Correction Based on Historical High-Quality Gradients

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

RFLPA: A Robust Federated Learning Framework against Poisoning Attacks with Secure Aggregation

FedRDF: A Robust and Dynamic Aggregation Function against Poisoning Attacks in Federated Learning

Collusive Backdoor Attacks in Federated Learning Frameworks for IoT Systems

FedDAA: a robust federated learning framework to protect privacy and defend against adversarial attack

ARFED: Attack-Resistant Federated averaging based on outlier elimination

Secure Weighted Aggregation for Federated Learning

Adaptive Aggregation Weight Assignment for Federated Learning: A Deep Reinforcement Learning Approach

Split Aggregation: Lightweight Privacy-Preserving Federated Learning Resistant to Byzantine Attacks

FedREAS: A Robust Efficient Aggregation and Selection Framework for Federated Learning