Abstract:In federated learning (FL), ensuring the efficiency of global models generated from the weighted aggregation of local models with data heterogeneity remains challenging. Moreover, the contradiction between imprecise aggregation weights and changing data distributions leads to aggregation errors that increase in an accelerated manner throughout the process. Therefore, we present federated learning using adaptive aggregate weights (FedAAW) to change the optimization direction in steps, including local training and global aggregation, and reduce inefficiencies in the global model due to the accelerated growth of aggregation errors resulting from changes in heterogeneity. In each round, the global- and local-model information is dynamically combined to generate an initial model at the beginning of the local training. The key module in FedAAW is adaptive aggregate weights (AAW), which are used to update the aggregation weight by sharing an optimization objective with global training and using the gradient information from other clients to accurately compute the updated aggregation weight direction. AAW guarantee consistency between weight update and global optimization, theoretically demonstrating convergence. The results of our comprehensive experiments on public datasets demonstrate that the test accuracy metrics of FedAAW are higher than those of six state-of-the-art algorithms and that FedAAW is capable of up to 50% improvement. FedAAW also results in an improvement of 14% on CIFAR100, a complex dataset, when compared with the best-performing baseline. FedAAW is faster than other algorithms in attaining the specified accuracy in experiments; in particular, it is approximately three times faster than federated learning with adaptive local aggregation. In addition, the results obtained in experimental environments with different client sizes and heterogeneous data confirm that FedAAW is robust and scalable.

CAAFL: A Client-Level Adaptive Acceletative Federated Learning Optimization Algorithm for Heterogeneous Data Scenarios

AFL-HCS: asynchronous federated learning based on heterogeneous edge client selection

FedCAda: Adaptive Client-Side Optimization for Accelerated and Stable Federated Learning

Tackling Data-Heterogeneity Variations in Federated Learning Via Adaptive Aggregate Weights

AFL-DCS: An asynchronous federated learning framework with dynamic client scheduling

Federated Learning Optimization Algorithm for Automatic Weight Optimal

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity

Asynchronous Federated Learning: A Scalable Approach for Decentralized Machine Learning

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

An EMD-Based Adaptive Client Selection Algorithm for Federated Learning in Heterogeneous Data Scenarios

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression.

FCFL: A Fairness Compensation-Based Federated Learning Scheme with Accumulated Queues

Ada‐FFL: Adaptive Computing Fairness Federated Learning

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

Adaptive Client Clustering for Efficient Federated Learning over Non-IID and Imbalanced Data

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients

FedAC: An Adaptive Clustered Federated Learning Framework for Heterogeneous Data

Adaptive Control of Client Selection and Gradient Compression for Efficient Federated Learning

Federated learning with workload-aware client scheduling in heterogeneous systems

An Efficient Client Clustering Algorithm for Clustered Federated Learning

Federated Learning Client Selection Mechanism under System and Data Heterogeneity