Abstract:In Federated Learning (FL), with parameter aggregated by a central node, the communication overhead is a substantial concern. To circumvent this limitation and alleviate the single point of failure within the FL framework, recent studies have introduced Decentralized Federated Learning (DFL) as a viable alternative. Considering the device heterogeneity, and energy cost associated with parameter aggregation, in this paper, the problem on how to efficiently leverage the limited resources available to enhance the model performance is investigated. Specifically, we formulate a problem that minimizes the loss function of DFL while considering energy and latency constraints. The proposed solution involves optimizing the number of local training rounds across diverse devices with varying resource budgets. To make this problem tractable, we first analyze the convergence of DFL with edge devices with different rounds of local training. The derived convergence bound reveals the impact of the rounds of local training on the model performance. Then, based on the derived bound, the closed-form solutions of rounds of local training in different devices are obtained. Meanwhile, since the solutions require the energy cost of aggregation as low as possible, we modify different graph-based aggregation schemes to solve this energy consumption minimization problem, which can be applied to different communication scenarios. Finally, a DFL framework which jointly considers the optimized rounds of local training and the energy-saving aggregation scheme is proposed. Simulation results show that, the proposed algorithm achieves a better performance than the conventional schemes with fixed rounds of local training, and consumes less energy than other traditional aggregation schemes.

Straggler-Aware Federated Learning Based on Adaptive Clustering to Support Edge Intelligence

Adaptive Clustering Based Straggler-aware Federated Learning in Wireless Edge Networks

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Asynchronous Federated Learning over Wireless Communication Networks.

A Cluster-Driven Adaptive Training Approach for Federated Learning

Federated Learning Using Sparse-Adaptive Model Selection for Embedded Edge Computing

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

FedEdge: Accelerating Edge-Assisted Federated Learning

Federated Learning Meets Edge Computing: A Hierarchical Aggregation Mechanism for Mobile Devices

FedLC: Accelerating Asynchronous Federated Learning in Edge Computing

EdgeFed: Optimized Federated Learning Based on Edge Computing

Computation Offloading for Edge-Assisted Federated Learning

FedTCR: Communication-Efficient Federated Learning Via Taming Computing Resources

Resource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing.

Federated Learning with Dynamic Epoch Adjustment and Collaborative Training in Mobile Edge Computing

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

Faster Convergence on Heterogeneous Federated Edge Learning: An Adaptive Clustered Data Sharing Approach

Asynchronous Online Federated Learning for Edge Devices with Non-IID Data