Abstract:In Federated Learning (FL), with parameter aggregated by a central node, the communication overhead is a substantial concern. To circumvent this limitation and alleviate the single point of failure within the FL framework, recent studies have introduced Decentralized Federated Learning (DFL) as a viable alternative. Considering the device heterogeneity, and energy cost associated with parameter aggregation, in this paper, the problem on how to efficiently leverage the limited resources available to enhance the model performance is investigated. Specifically, we formulate a problem that minimizes the loss function of DFL while considering energy and latency constraints. The proposed solution involves optimizing the number of local training rounds across diverse devices with varying resource budgets. To make this problem tractable, we first analyze the convergence of DFL with edge devices with different rounds of local training. The derived convergence bound reveals the impact of the rounds of local training on the model performance. Then, based on the derived bound, the closed-form solutions of rounds of local training in different devices are obtained. Meanwhile, since the solutions require the energy cost of aggregation as low as possible, we modify different graph-based aggregation schemes to solve this energy consumption minimization problem, which can be applied to different communication scenarios. Finally, a DFL framework which jointly considers the optimized rounds of local training and the energy-saving aggregation scheme is proposed. Simulation results show that, the proposed algorithm achieves a better performance than the conventional schemes with fixed rounds of local training, and consumes less energy than other traditional aggregation schemes.

Decentralized Federated Learning with Data Feature Transmission and Neighbor Selection.

Edge-cloud Collaborative Learning with Federated and Centralized Features

Decentralized Federated Learning with Intermediate Results in Mobile Edge Computing

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Decentralized Federated Learning under Communication Delays.

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

BlockDFL: A Blockchain-based Fully Decentralized Peer-to-Peer Federated Learning Framework

Like Attracts Like: Personalized Federated Learning in Decentralized Edge Computing

Enhancing Decentralized Federated Learning with Model Pruning and Adaptive Communication

DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

Asynchronous Decentralized Federated Learning for Heterogeneous Devices

Efficient and Less Centralized Federated Learning

Privacy-Enhanced Decentralized Federated Learning at Dynamic Edge

FedEdge: Accelerating Edge-Assisted Federated Learning

Communication-Efficient and Privacy-Preserving Aggregation in Federated Learning With Adaptability

Adaptive Configuration for Heterogeneous Participants in Decentralized Federated Learning

Confederated Learning: Federated Learning with Decentralized Edge Servers

Accelerating Federated Learning with Model Segmentation for Edge Networks

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

Accelerating Federated Learning Via Parameter Selection and Pre-Synchronization in Mobile Edge-Cloud Networks