Abstract:In the field of Natural Language Processing (NLP), Deep Learning (DL) and Neural Network (NN) technologies have been widely applied to machine translation and sentiment analysis and have demonstrated outstanding performance. In recent years, NLP applications have also combined multimodal data, such as visual and audio, continuously improving language processing performance. At the same time, the size of Neural Network models is increasing, and many models cannot be deployed on devices with limited computing resources. Deploying models on cloud platforms has become a trend. However, deploying models in the cloud introduces new privacy risks for endpoint data, despite overcoming computational limitations. Federated Learning (FL) methods protect local data by keeping the data on the client side and only sending local updates to the central server. However, the FL architecture still has problems, such as vulnerability to adversarial attacks and non-IID data distribution. In this work, we propose a Federated Learning aggregation method called FedREAS. The server uses a benchmark dataset to train a global model and obtains benchmark updates in this method. Before aggregating local updates, the server adjusts the local updates using the benchmark updates and then returns the adjusted benchmark updates. Then, based on the similarity between the adjusted local updates and the adjusted benchmark updates, the server aggregates these local updates to obtain a more robust update. This method also improves the client selection process. FedREAS selects suitable clients for training at the beginning of each round based on specific strategies, the similarity of the previous round’s updates, and the submitted data. We conduct experiments on different datasets and compare FedREAS with other Federated Learning methods. The results show that FedREAS outperforms other methods regarding model performance and resistance to attacks.

Joint Local Relational Augmentation and Global Nash Equilibrium for Federated Learning with Non-IID Data

Improving Federated Relational Data Modeling via Basis Alignment and Weight Penalty

FedDGP: Disentangling Global and Personal Models for Federated Learning

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Adaptive Federated Learning on Non-IID Data with Resource Constraint

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning

Federated Learning for Non-IID Data Via Unified Feature Learning and Optimization Objective Alignment

FedRDS: Federated Learning on Non-IID Data Via Regularization and Data Sharing

Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning

Collaboration Equilibrium in Federated Learning

A Survey of Federated Learning on Non-IID Data

Reinforcement Learning As a Catalyst for Robust and Fair Federated Learning: Deciphering the Dynamics of Client Contributions

FedGA: A Greedy Approach to Enhance Federated Learning with Non-IID Data

Collaboratively Learning Federated Models from Noisy Decentralized Data

FedREAS: A Robust Efficient Aggregation and Selection Framework for Federated Learning

Federated Loss Exploration for Improved Convergence on Non-IID Data

A Fair Federated Learning Framework with Reinforcement Learning.

Federated learning on non-IID and long-tailed data via dual-decoupling

DYNAFED: Tackling Client Data Heterogeneity with Global Dynamics

Feature Norm Regularized Federated Learning: Utilizing Data Disparities for Model Performance Gains

Federated Learning on Non-Independent and Identically Distributed Data