Abstract:In Federated Learning (FL), with parameter aggregated by a central node, the communication overhead is a substantial concern. To circumvent this limitation and alleviate the single point of failure within the FL framework, recent studies have introduced Decentralized Federated Learning (DFL) as a viable alternative. Considering the device heterogeneity, and energy cost associated with parameter aggregation, in this paper, the problem on how to efficiently leverage the limited resources available to enhance the model performance is investigated. Specifically, we formulate a problem that minimizes the loss function of DFL while considering energy and latency constraints. The proposed solution involves optimizing the number of local training rounds across diverse devices with varying resource budgets. To make this problem tractable, we first analyze the convergence of DFL with edge devices with different rounds of local training. The derived convergence bound reveals the impact of the rounds of local training on the model performance. Then, based on the derived bound, the closed-form solutions of rounds of local training in different devices are obtained. Meanwhile, since the solutions require the energy cost of aggregation as low as possible, we modify different graph-based aggregation schemes to solve this energy consumption minimization problem, which can be applied to different communication scenarios. Finally, a DFL framework which jointly considers the optimized rounds of local training and the energy-saving aggregation scheme is proposed. Simulation results show that, the proposed algorithm achieves a better performance than the conventional schemes with fixed rounds of local training, and consumes less energy than other traditional aggregation schemes.

Efficient Communication for Decentralized Federated Learning: an Energy Disaggregation Case Study

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

Lazily Aggregated Quantized Gradient Innovation for Communication-Efficient Federated Learning.

Hierarchical federated learning based on wireless D2D networks

Communication-Efficient Learning of Deep Networks from Decentralized Data

Communication-Efficient Federated Learning in Channel Constrained Internet of Things

Federated Learning: Strategies for Improving Communication Efficiency

Efficient Model Compression for Hierarchical Federated Learning

Energy Efficient Federated Learning Over Wireless Communication Networks

Efficient and Less Centralized Federated Learning

Decentralized Federated Learning with Data Feature Transmission and Neighbor Selection.

Learn More by Using Less: Distributed Learning with Energy-Constrained Devices

FedSQ: Sparse-Quantized Federated Learning for Communication Efficiency

Federated Optimization Based on Compression and Event-triggered Communication

FedStar: Efficient Federated Learning on Heterogeneous Communication Networks

FedSVRG Based Communication Efficient Scheme for Federated Learning in MEC Networks

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

AFedAvg: communication-efficient federated learning aggregation with adaptive communication frequency and gradient sparse

DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training

Communication-Efficient Model Aggregation with Layer Divergence Feedback in Federated Learning

Communication Efficient Federated Learning With Heterogeneous Structured Client Models