Abstract:The rapid expansion of artificial intelligence (AI) applications has raised significant concerns about user privacy, prompting the development of privacy-preserving machine learning (ML) paradigms such as federated learning (FL). FL enables the distributed training of ML models, keeping data on local devices and thus addressing the privacy concerns of users. However, challenges arise from the heterogeneous nature of mobile client devices, partial engagement of training, and non-independent identically distributed (non-IID) data distribution, leading to performance degradation and optimization objective bias in FL training. With the development of 5G/6G networks and the integration of cloud computing edge computing resources, globally distributed cloud computing resources can be effectively utilized to optimize the FL process. Through the specific parameters of the server through the selection mechanism, it does not increase the monetary cost and reduces the network latency overhead, but also balances the objectives of communication optimization and low engagement mitigation that cannot be achieved simultaneously in a single-server framework of existing works. In this paper, we propose the FedAdaSS algorithm, an adaptive parameter server selection mechanism designed to optimize the training efficiency in each round of FL training by selecting the most appropriate server as the parameter server. Our approach leverages the flexibility of cloud resource computing power, and allows organizers to strategically select servers for data broadcasting and aggregation, thus improving training performance while maintaining cost efficiency. The FedAdaSS algorithm estimates the utility of client systems and servers and incorporates an adaptive random reshuffling strategy that selects the optimal server in each round of the training process. Theoretical analysis confirms the convergence of FedAdaSS under strong convexity and L-smooth assumptions, and comparative experiments within the FLSim framework demonstrate a reduction in training round-to-accuracy by 12%-20% compared to the Federated Averaging (FedAvg) with random reshuffling method under unique server. Furthermore, FedAdaSS effectively mitigates performance loss caused by low client engagement, reducing the loss indicator by 50%.

Federated Learning Optimization Algorithm for Automatic Weight Optimal

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data.

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Tackling Data-Heterogeneity Variations in Federated Learning Via Adaptive Aggregate Weights

Takle the Data Heterogeneous Variations in Federated Learning Via Adaptive Aggregate Weights

Federated learning with workload-aware client scheduling in heterogeneous systems

FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity

FedPD: A Federated Learning Framework With Adaptivity to Non-IID Data

Federated Learning Client Selection Mechanism under System and Data Heterogeneity

CAAFL: A Client-Level Adaptive Acceletative Federated Learning Optimization Algorithm for Heterogeneous Data Scenarios

FedAWARE: Maximizing Gradient Diversity for Heterogeneous Federated Server-side Optimization

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression.

Communication-Efficient Zeroth-Order Adaptive Optimization for Federated Learning

On the Power of Adaptive Weighted Aggregation in Heterogeneous Federated Learning and Beyond

Data-Quality-Driven Federated Learning for Optimizing Communication Costs

FedSW: Federated learning with adaptive sample weights

Noise-Robust and Resource-Efficient ADMM-based Federated Learning

Fairness and Accuracy in Federated Learning

FedAdaSS: Federated Learning with Adaptive Parameter Server Selection Based on Elastic Cloud Resources