Abstract:Semi-decentralized federated learning blends the conventional device-to-server (D2S) interaction structure of federated model training with localized device-to-device (D2D) communications. We study this architecture over edge networks with multiple D2D clusters modeled as time-varying and directed communication graphs. Our investigation results in two algorithms: (a) a connectivity-aware learning algorithm that controls the fundamental trade-off between the convergence rate of the model training process and the number of energy-intensive D2S transmissions required for global aggregation, and (b) a motion-planning algorithm to enhance the densities and regularity levels of cluster digraphs so as to further reduce the number of D2S transmissions in connectivity-aware learning. Specifically, in our semi-decentralized methodology, weighted-averaging-based D2D updates are injected into the federated averaging framework based on column-stochastic weight matrices that encapsulate the connectivity within the clusters. To develop our algorithm, we show how the current expected optimality gap (i.e., the distance between the most recent global model computed by the server and the target/desired optimal model) depends on the greatest two singular values of the weighted adjacency matrices (and hence on the densities and degrees of digraph regularity) of the D2D clusters. We then derive tight bounds on these singular values in terms of the node degrees of the D2D clusters, and we use the resulting expressions to design our connectivity-aware learning algorithm. Simulations performed using real-world datasets and Random Direction Mobility Model (RDMM)-based time-varying D2D topologies reveal that our connectivity-aware algorithm significantly reduces the total communication energy required to reach a target accuracy level compared with baselines while achieving the accuracy level in nearly the same number of iterations as these baselines.

Efficient Collaborative Learning over Unreliable D2D Network: Adaptive Cluster Head Selection and Resource Allocation

Adaptive Cluster Head Selection and Spectrum Allocation for D2D-Enabled Collaborative Learning

Towards Efficient Scheduling of Federated Mobile Devices under Computational and Statistical Heterogeneity

Optimize Scheduling of Federated Learning on Battery-powered Mobile Devices

Hierarchical federated learning based on wireless D2D networks

Energy-Efficient Connectivity-Aware Learning Over Time-Varying D2D Networks

Decentralized Edge Learning via Unreliable Device-to-Device Communications

Over-the-air Learning Rate Optimization for Federated Learning

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Federated Learning in Multi-RIS-Aided Systems

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

Accelerating Resource Allocation for D2D Communications Using Imitation Learning

D2D-Enabled Data Sharing for Distributed Machine Learning at Wireless Network Edge

Decentralized Federated Learning with Unreliable Communications

Clustered Data Sharing for Non-IID Federated Learning over Wireless Networks

Energy-Efficient Mutual Learning over D2D Communications

Topology Learning for Heterogeneous Decentralized Federated Learning Over Unreliable D2D Networks

Learning to Collaborate in Decentralized Learning of Personalized Models

AC-DNN: An Adaptive Compact DNNs Architecture for Collaborative Learning Among Heterogeneous Smart Devices

A Hybrid Clustered Approach for Enhanced Communication and Model Performance in Blockchain-Based Collaborative Learning

Federated Learning with Pareto Optimality for Resource Efficiency and Fast Model Convergence in Mobile Environments