Abstract:Federated Learning (FL), as a privacy-preserving machine learning paradigm, trains a global model across devices without exposing local data. However, resource heterogeneity and inevitable stragglers in wireless networks severely impact the efficiency and accuracy of FL training. In this paper, we propose a novel Dynamic Cross-Tier Federated Learning framework (FedDCT). Firstly, we design a dynamic tiering strategy that dynamically partitions devices into different tiers based on their response times and assigns specific timeout thresholds to each tier to reduce single-round training time. Then, we propose a cross-tier device selection algorithm that selects devices that respond quickly and are conducive to model convergence to improve convergence efficiency and accuracy. Experimental results demonstrate that the proposed approach under wireless networks outperforms the baseline approach, with an average reduction of 54.7\% in convergence time and an average improvement of 1.83\% in convergence accuracy.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the low training efficiency and insufficient convergence accuracy of Federated Learning (FL) in wireless network environments due to resource heterogeneity and device dropout. Specifically: 1. **Resource Heterogeneity**: In wireless networks, there are significant differences in the computing and communication resources of different devices, which can lead to overly long response times for some devices, thereby affecting the efficiency of the entire federated learning process. 2. **Device Dropout**: Devices in wireless networks may drop out due to communication failures or device malfunctions, further exacerbating the inefficiency of a single - round training. To solve these problems, the paper proposes a new dynamic cross - layer federated learning framework (FedDCT), whose main goals are: - To reduce the single - round training time and improve training efficiency through a dynamic layering strategy. - To further improve the convergence efficiency and accuracy by selecting devices with fast response speeds and conducive to model convergence through a cross - layer device selection algorithm. ### Main Contributions 1. **Dynamic Layering Strategy**: Real - time evaluation of device response times, dividing them into different logical layers, and assigning specific timeout thresholds to each layer, thereby improving the convergence efficiency of federated learning. 2. **Cross - layer Device Selection Strategy**: First, adaptively select layers that contribute to model convergence and have fast response times, and then select devices participating in training from these layers, effectively optimizing the utilization of idle resources and improving the convergence speed and accuracy. 3. **Experimental Verification**: Through simulation experiments, it is verified that the proposed method reduces the average convergence time by 54.7% and improves the convergence accuracy by 1.83% compared with the baseline methods in wireless network scenarios. ### Dynamic Layering Module - **Evaluating the Average Response Time**: The dynamic layering module evaluates the average response time of all participating devices in real - time. - **Layering**: Divide devices into multiple logical layers according to their average response times. - **Calculating the Timeout Threshold**: Calculate the timeout threshold for devices within each layer to prevent excessive waiting times caused by resource heterogeneity and device dropout. ### Cross - layer Device Selection Module - **Selecting Participating Layers**: Based on the change in the accuracy of the global aggregation model, select the layers participating in the current training round. - **Selecting Devices**: Select devices participating in training from the selected layers, ensuring fast response performance while guaranteeing model convergence. ### Experimental Results - **Data Sets**: Use three commonly used data sets, MNIST, CIFAR - 10, and Fashion - MNIST, for experiments. - **Models**: Use two classic neural network models, CNN and ResNet8, for training. - **Performance Comparison**: Compared with three classic algorithms, synchronous FL (FedAvg), asynchronous FL (FedAsync), and hierarchical FL (TiFL), the results show that FedDCT exhibits higher convergence accuracy and significantly reduced convergence time in all experiments. In conclusion, FedDCT effectively solves the impact of resource heterogeneity and device dropout on federated learning in wireless networks through dynamic layering and cross - layer device selection strategies, improving training efficiency and model convergence accuracy.

FedDCT: A Dynamic Cross-Tier Federated Learning Framework in Wireless Networks

Asynchronous Federated Learning over Wireless Communication Networks.

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Time-triggered Federated Learning over Wireless Networks

Hierarchical federated learning based on wireless D2D networks

Speed Up Federated Learning in Heterogeneous Environment: A Dynamic Tiering Approach

Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better

FedStar: Efficient Federated Learning on Heterogeneous Communication Networks

Data Collaborative Federated Learning for Non-i.i.d Data in Wireless Networks

FedTCR: Communication-Efficient Federated Learning Via Taming Computing Resources

Communication-Efficient Federated Learning in Channel Constrained Internet of Things

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection

FedPCC: Parallelism of Communication and Computation for Federated Learning in Wireless Networks

Dynamic Clustering and Power Control for Two-Tier Wireless Federated Learning

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation

Federated Learning Over Wireless Channels: Dynamic Resource Allocation and Task Scheduling

FedACT: an Adaptive Chained Training Approach for Federated Learning in Computing Power Networks

Efficient and Less Centralized Federated Learning

Device Scheduling with Fast Convergence for Wireless Federated Learning

Adaptive Training and Aggregation for Federated Learning in Multi-tier Computing Networks