Abstract:In Federated Learning (FL), with parameter aggregated by a central node, the communication overhead is a substantial concern. To circumvent this limitation and alleviate the single point of failure within the FL framework, recent studies have introduced Decentralized Federated Learning (DFL) as a viable alternative. Considering the device heterogeneity, and energy cost associated with parameter aggregation, in this paper, the problem on how to efficiently leverage the limited resources available to enhance the model performance is investigated. Specifically, we formulate a problem that minimizes the loss function of DFL while considering energy and latency constraints. The proposed solution involves optimizing the number of local training rounds across diverse devices with varying resource budgets. To make this problem tractable, we first analyze the convergence of DFL with edge devices with different rounds of local training. The derived convergence bound reveals the impact of the rounds of local training on the model performance. Then, based on the derived bound, the closed-form solutions of rounds of local training in different devices are obtained. Meanwhile, since the solutions require the energy cost of aggregation as low as possible, we modify different graph-based aggregation schemes to solve this energy consumption minimization problem, which can be applied to different communication scenarios. Finally, a DFL framework which jointly considers the optimized rounds of local training and the energy-saving aggregation scheme is proposed. Simulation results show that, the proposed algorithm achieves a better performance than the conventional schemes with fixed rounds of local training, and consumes less energy than other traditional aggregation schemes.

Adaptive Clustering Based Straggler-aware Federated Learning in Wireless Edge Networks

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Asynchronous Federated Learning over Wireless Communication Networks.

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

A Cluster-Driven Adaptive Training Approach for Federated Learning

Adaptive Hierarchical Federated Learning Over Wireless Networks

Faster Convergence on Heterogeneous Federated Edge Learning: An Adaptive Clustered Data Sharing Approach

Federated Learning Using Sparse-Adaptive Model Selection for Embedded Edge Computing

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

A Joint Gradient and Loss Based Clustered Federated Learning Design

Asynchronous Online Federated Learning for Edge Devices with Non-IID Data

A General Solution for Straggler Effect and Unreliable Communication in Federated Learning

Time-triggered Federated Learning over Wireless Networks

Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach

Resilient and Communication Efficient Learning for Heterogeneous Federated Systems

Adaptive Federated Learning in Resource Constrained Edge Computing Systems