Abstract:In federated learning (FL), ensuring the efficiency of global models generated from the weighted aggregation of local models with data heterogeneity remains challenging. Moreover, the contradiction between imprecise aggregation weights and changing data distributions leads to aggregation errors that increase in an accelerated manner throughout the process. Therefore, we present federated learning using adaptive aggregate weights (FedAAW) to change the optimization direction in steps, including local training and global aggregation, and reduce inefficiencies in the global model due to the accelerated growth of aggregation errors resulting from changes in heterogeneity. In each round, the global- and local-model information is dynamically combined to generate an initial model at the beginning of the local training. The key module in FedAAW is adaptive aggregate weights (AAW), which are used to update the aggregation weight by sharing an optimization objective with global training and using the gradient information from other clients to accurately compute the updated aggregation weight direction. AAW guarantee consistency between weight update and global optimization, theoretically demonstrating convergence. The results of our comprehensive experiments on public datasets demonstrate that the test accuracy metrics of FedAAW are higher than those of six state-of-the-art algorithms and that FedAAW is capable of up to 50% improvement. FedAAW also results in an improvement of 14% on CIFAR100, a complex dataset, when compared with the best-performing baseline. FedAAW is faster than other algorithms in attaining the specified accuracy in experiments; in particular, it is approximately three times faster than federated learning with adaptive local aggregation. In addition, the results obtained in experimental environments with different client sizes and heterogeneous data confirm that FedAAW is robust and scalable.

A High-Performance Federated Learning Aggregation Algorithm Based on Learning Rate Adjustment and Client Sampling

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

An Efficient and Robust Aggregation Algorithm for Learning Federated CNN.

A Federated Learning Aggregation That Integrates Clustering and Momentum Correction Based on Historical High-Quality Gradients

FLAS: Computation and Communication Efficient Federated Learning via Adaptive Sampling

When to Trust Aggregated Gradients: Addressing Negative Client Sampling in Federated Learning

Tackling Data-Heterogeneity Variations in Federated Learning Via Adaptive Aggregate Weights

FedAgg: Adaptive Federated Learning with Aggregated Gradients

Fast-convergent Federated Learning with Class-Weighted Aggregation

Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints

A Novel Server-side Aggregation Strategy for Federated Learning in Non-IID Situations

FedAG:A Federated Learning Method Based on Data Importance Weighted Aggregation

Federated Learning Aggregation: New Robust Algorithms with Guarantees

Robust Model Aggregation for Federated Learning with Heterogeneous Clients

Federated Learning Aggregation based on Weight Distribution Analysis

Precision-Weighted Federated Learning

Dual-Criterion Model Aggregation in Federated Learning: Balancing Data Quantity and Quality

Fed-RHLP: Enhancing Federated Learning with Random High-Local Performance Client Selection for Improved Convergence and Accuracy

CAAFL: A Client-Level Adaptive Acceletative Federated Learning Optimization Algorithm for Heterogeneous Data Scenarios

Performance Enhancement in Federated Learning by Reducing Class Imbalance of Non-IID Data