Abstract:In today's era, there is a growing concern about data privacy and security. Data is the foundation of machine learning, and due to the complexity of the reality, data often exists in silos. The great development of computing and storage capacity of edge devices has made it possible to train machine learning models on edge devices with data. Federated learning is a special kind of distributed machine learning in which multiple distributed clients use local data to train a model and upload the resulting model parameters to a central server for aggregation and iteration to finally obtain a global model with good generalization performance. The interaction between the clients and the server is model parameters rather than the data itself, which effectively protects data privacy and security. After research, it is found that Federated Learning is mainly divided into two aggregation models: synchronous aggregation and asynchronous aggregation. In this paper, the classical FedAvg synchronous federated average aggregation algorithm is analyzed. The central server needs to wait for all participating nodes to be trained before aggregating and updating the model, which is inconvenient to achieve global synchronization on resource heterogeneous clients. To improve the utilization of computational resources, FedAsync, an asynchronous federated learning aggregation mechanism with a receivable window based on dual weights, which are data volume size weight and staleness weight, is proposed. And FedAvg and FedAsync are tested and analyzed. Based on this, the impact on federated learning due to asynchronous data arrival rate and limited communication resources is further explored.

Efficient Asynchronous Vertical Federated Learning via Gradient Prediction and Double-End Sparse Compression

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

Accelerating Vertical Federated Learning

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Efficient Asynchronous Multi-Participant Vertical Federated Learning

Secure and fast asynchronous Vertical Federated Learning via cascaded hybrid optimization

A Joint Approach to Local Updating and Gradient Compression for Efficient Asynchronous Federated Learning

Privacy-Preserving Asynchronous Vertical Federated Learning Algorithms for Multiparty Collaborative Learning

Accelerated Methods with Compression for Horizontal and Vertical Federated Learning

FedGBF: An efficient vertical federated learning framework via gradient boosting and bagging

VAFL: a Method of Vertical Asynchronous Federated Learning

A Communication Efficient Vertical Federated Learning Framework.

Research and Implementation of Asynchronous Transmission and Update Strategy for Federated Learning

Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach

A Novel Adaptive Gradient Compression Approach for Communication-Efficient Federated Learning

Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients

AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilization

Privacy-Preserving Asynchronous Federated Learning Algorithms for Multi-Party Vertically Collaborative Learning

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Efficient Asynchronous Federated Learning with Prospective Momentum Aggregation and Fine-Grained Correction