Abstract:In the field of Natural Language Processing (NLP), Deep Learning (DL) and Neural Network (NN) technologies have been widely applied to machine translation and sentiment analysis and have demonstrated outstanding performance. In recent years, NLP applications have also combined multimodal data, such as visual and audio, continuously improving language processing performance. At the same time, the size of Neural Network models is increasing, and many models cannot be deployed on devices with limited computing resources. Deploying models on cloud platforms has become a trend. However, deploying models in the cloud introduces new privacy risks for endpoint data, despite overcoming computational limitations. Federated Learning (FL) methods protect local data by keeping the data on the client side and only sending local updates to the central server. However, the FL architecture still has problems, such as vulnerability to adversarial attacks and non-IID data distribution. In this work, we propose a Federated Learning aggregation method called FedREAS. The server uses a benchmark dataset to train a global model and obtains benchmark updates in this method. Before aggregating local updates, the server adjusts the local updates using the benchmark updates and then returns the adjusted benchmark updates. Then, based on the similarity between the adjusted local updates and the adjusted benchmark updates, the server aggregates these local updates to obtain a more robust update. This method also improves the client selection process. FedREAS selects suitable clients for training at the beginning of each round based on specific strategies, the similarity of the previous round’s updates, and the submitted data. We conduct experiments on different datasets and compare FedREAS with other Federated Learning methods. The results show that FedREAS outperforms other methods regarding model performance and resistance to attacks.

Reinforcement Learning As a Catalyst for Robust and Fair Federated Learning: Deciphering the Dynamics of Client Contributions

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

A Fair Federated Learning Framework with Reinforcement Learning.

A Reputation Mechanism Is All You Need: Collaborative Fairness and Adversarial Robustness in Federated Learning

Fairness-Aware Client Selection for Federated Learning

Dynamic Fair Federated Learning Based on Reinforcement Learning

Welfare and Fairness Dynamics in Federated Learning: A Client Selection Perspective

Tackling Selfish Clients in Federated Learning

Shielding Federated Learning: Robust Aggregation with Adaptive Client Selection

FedLaw: Value-Aware Federated Learning with Individual Fairness and Coalition Stability

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

A Secure and Fair Federated Learning Framework Based on Consensus Incentive Mechanism

Multi-Dimensional Fair Federated Learning

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

FedFAIM: A Model Performance-based Fair Incentive Mechanism for Federated Learning

Fair and Robust Federated Learning via Decentralized and Adaptive Aggregation based on Blockchain

FedUP: Bridging Fairness and Efficiency in Cross-Silo Federated Learning

Adaptive Aggregation Weight Assignment for Federated Learning: A Deep Reinforcement Learning Approach

FedREAS: A Robust Efficient Aggregation and Selection Framework for Federated Learning

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning