Abstract:In the field of Natural Language Processing (NLP), Deep Learning (DL) and Neural Network (NN) technologies have been widely applied to machine translation and sentiment analysis and have demonstrated outstanding performance. In recent years, NLP applications have also combined multimodal data, such as visual and audio, continuously improving language processing performance. At the same time, the size of Neural Network models is increasing, and many models cannot be deployed on devices with limited computing resources. Deploying models on cloud platforms has become a trend. However, deploying models in the cloud introduces new privacy risks for endpoint data, despite overcoming computational limitations. Federated Learning (FL) methods protect local data by keeping the data on the client side and only sending local updates to the central server. However, the FL architecture still has problems, such as vulnerability to adversarial attacks and non-IID data distribution. In this work, we propose a Federated Learning aggregation method called FedREAS. The server uses a benchmark dataset to train a global model and obtains benchmark updates in this method. Before aggregating local updates, the server adjusts the local updates using the benchmark updates and then returns the adjusted benchmark updates. Then, based on the similarity between the adjusted local updates and the adjusted benchmark updates, the server aggregates these local updates to obtain a more robust update. This method also improves the client selection process. FedREAS selects suitable clients for training at the beginning of each round based on specific strategies, the similarity of the previous round’s updates, and the submitted data. We conduct experiments on different datasets and compare FedREAS with other Federated Learning methods. The results show that FedREAS outperforms other methods regarding model performance and resistance to attacks.

FedDRL: A Trustworthy Federated Learning Model Fusion Method Based on Staged Reinforcement Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedTKD: A Trustworthy Heterogeneous Federated Learning Based on Adaptive Knowledge Distillation

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning

Dynamic Fair Federated Learning Based on Reinforcement Learning

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

Ensemble Distillation for Robust Model Fusion in Federated Learning

Model Fusion from Unauthorized Clients in Federated Learning

FedDdrl: Federated Double Deep Reinforcement Learning for Heterogeneous IoT with Adaptive Early Client Termination and Local Epoch Adjustment

Reinforcement Learning As a Catalyst for Robust and Fair Federated Learning: Deciphering the Dynamics of Client Contributions

Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusion

FedMD: Heterogenous Federated Learning via Model Distillation

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

R $^{2}$ Fed: Resilient Reinforcement Federated Learning for Industrial Applications

FedMR: Federated Learning Via Model Recombination

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

Federated Model Search Via Reinforcement Learning

Server-Client Collaborative Distillation for Federated Reinforcement Learning

Is Aggregation the Only Choice? Federated Learning via Layer-wise Model Recombination

FedREAS: A Robust Efficient Aggregation and Selection Framework for Federated Learning

FedRAD: Heterogeneous Federated Learning via Relational Adaptive Distillation