Abstract:Federated learning (FL), a distributed machine-learning framework, is poised to effectively protect data privacy and security, and it also has been widely applied in variety of fields in recent years. However, the system heterogeneity and statistical heterogeneity of FL pose serious obstacles to the global model's quality. This study investigates server and client resource allocation in the context of FL system resource efficiency and offers the FedAwo optimization algorithm. This approach combines adaptive learning with federated learning, and makes full use of the computing resources of the server to calculate the optimal weight value corresponding to each client. This approach aggregated the global model according to the optimal weight value, which significantly minimizes the detrimental effects of statistical and system heterogeneity. In the process of traditional FL, we found that a large number of client trainings converge earlier than the specified epoch. However, according to the provisions of traditional FL, the client still needs to be trained for the specified epoch, which leads to the meaningless of a large number of calculations in the client. To further lower the training cost, the augmentation FedAwo ∗ algorithm is proposed. The FedAwo ∗ algorithm takes into account the heterogeneity of clients and sets the criteria for local convergence. When the local model of the client reaches the criteria, it will be returned to the server immediately. In this way, the epoch of the client can dynamically be modified adaptively. A large number of experiments based on MNIST and Fashion-MNIST public datasets reveal that the global model converges faster and has higher accuracy in FedAwo and FedAwo ∗ algorithms than FedAvg, FedProx, and FedAdp baseline algorithms.

Towards Federated Learning on Fresh Datasets

Age-of-Information-Aware Federated Learning

A Survey of Federated Learning on Non-IID Data

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Sample-level Data Selection for Federated Learning.

Client Selection in Federated Learning: Principles, Challenges, and Opportunities

Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing

Welfare and Fairness Dynamics in Federated Learning: A Client Selection Perspective

Advancements in Federated Learning: Models, Methods, and Privacy

Fairness-Aware Client Selection for Federated Learning

Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning

Advances and Open Problems in Federated Learning

A Snapshot of the Frontiers of Client Selection in Federated Learning

Federated Learning with Reduced Information Leakage and Computation

A New Implementation of Federated Learning for Privacy and Security Enhancement

Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategies

Federated Learning Optimization Algorithm for Automatic Weight Optimal

Rethinking Client Drift in Federated Learning: A Logit Perspective

Online Client Selection for Asynchronous Federated Learning With Fairness Consideration