Abstract:Federated Learning has sparked increasing interest as a promising approach to utilize large amounts of data stored on network edge devices. Federated Averaging is the most widely accepted Federated Learning framework. In Federated Averaging, the server keeps waiting for client models to compute the global model in each round unless all client models are received or a pre-configured timer expires, therefore it suffers seriously from participant devices with weak computation and/or communication capability, which is a kind of straggler problem. In this paper we design FedPA, a framework based on partial model aggregation strategy, in which the server waits for only an appropriate number of device models (referred to as aggregation number) in each round. Our experiment shows that the accuracy loss of the aggregated global model in a single round is not significant if the aggregation number is decided carefully. We propose a waiting strategy to determine the aggregation number for each round dynamically and the aggregation number is adaptive to achieve a tradeoff between single-round training time and the expected number of rounds to reach the target accuracy. Stale models are also included during aggregation when they arrive, and their positive value and negative effect are carefully evaluated and reflected in the aggregation strategy. Experiments show that FedPA outperforms the baseline strategy FedAvg and other three algorithms named FedAsync, FLANP and AD-SG. It can work well in all scenarios with different distributions of data samples (characterized by non-IID ratio) and computation/communication capability (characterized by level of heterogeneity) among devices. Experiments also show that FedPA is robust when a certain amount of noise is added into the input from clients for privacy concerns.

FedAGA: A federated learning framework for enhanced inter-client relationship learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

Improving Federated Relational Data Modeling via Basis Alignment and Weight Penalty

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

FedGA: A Greedy Approach to Enhance Federated Learning with Non-IID Data

FedALA: Adaptive Local Aggregation for Personalized Federated Learning

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity

FedAS: Bridging Inconsistency in Personalized Federated Learning

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

FedPA: An adaptively partial model aggregation strategy in Federated Learning

FedAgg: Adaptive Federated Learning with Aggregated Gradients

FedAG:A Federated Learning Method Based on Data Importance Weighted Aggregation

FedGraph: an Aggregation Method from Graph Perspective

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Personalized Federated Learning with Inferred Collaboration Graphs.

FedSG: A Personalized Subgraph Federated Learning Framework on Multiple Non-IID Graphs

Enhancing Federated Graph Learning via Adaptive Fusion of Structural and Node Characteristics

FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation

Pfedbea: Combatting Data Heterogeneity for Personalized Federated Learning by Body Exchange and Aggregation Abandon