Abstract:Federated learning aims to construct a global model that fits the dataset distributed across local devices without direct access to private data, leveraging communication between a server and the local devices. In the context of a practical communication scheme, we study the completion time required to achieve a target performance. Specifically, we analyze the number of iterations required for federated learning to reach a specific optimality gap from a minimum global loss. Subsequently, we characterize the time required for each iteration under two fundamental multiple access schemes: time-division multiple access (TDMA) and random access (RA). We propose a step-wise batch allocation, demonstrated to be optimal for TDMA-based federated learning systems. Additionally, we show that the non-zero batch gap between devices provided by the proposed step-wise batch allocation significantly reduces the completion time for RA-based learning systems. Numerical evaluations validate these analytical results through real-data experiments, highlighting the remarkable potential for substantial completion time reduction.

What problem does this paper attempt to address?

### Problems the paper attempts to solve This paper aims to solve the batch - processing allocation optimization problem in the wireless Federated Learning (FL) system to reduce the completion time. Specifically, the main research objectives are: 1. **Reduce the completion time required to reach the target performance**: Analyze the time required for Federated Learning to reach a specific optimality gap in the context of practical communication schemes. By optimizing the batch - processing allocation strategy, reduce the time required for each iteration, thereby shortening the overall completion time. 2. **Optimize the batch - processing allocation strategy**: For two basic multiple - access schemes - Time - Division Multiple Access (TDMA) and Random Access (RA), a step - by - step batch - processing allocation algorithm is proposed. This algorithm is proven to be optimal on the basis of TDMA, and can also significantly reduce the completion time on the basis of RA. 3. **Relieve the communication bottleneck**: Since Federated Learning needs to communicate in each round of iteration, this may cause the communication overhead to become a bottleneck. By optimizing batch - processing allocation, the number of communications and the time of each communication can be reduced, thereby improving the efficiency of the system. 4. **Handle large - scale data and privacy protection**: With the increase in the number of Internet of Things (IoT) devices, the amount of data generated is huge, and at the same time, this data is often sensitive. Federated Learning provides a method for constructing a global model without directly accessing local data, but still faces the challenge of low communication efficiency. This paper improves the efficiency of Federated Learning by optimizing batch - processing allocation, so as to better meet these challenges. ### Specific problem description - **Batch - processing allocation problem**: How to allocate an appropriate batch - processing size for each device to minimize the completion time. Traditional equal - batch allocation may lead to excessive interference and congestion, especially when a large number of devices are involved. - **Choice of multiple - access schemes**: The influence of two multiple - access schemes, TDMA and RA, on batch - processing allocation is studied, and the optimal batch - processing allocation strategies for these two schemes are proposed. - **Theoretical analysis and experimental verification**: Derive the expression of the completion time through theoretical analysis, and prove the effectiveness of the proposed batch - processing allocation algorithm through experiments. ### Summary The paper solves the problems of low communication efficiency and long completion time in the wireless Federated Learning system by optimizing the batch - processing allocation strategy. In particular, under the two multiple - access schemes of TDMA and RA, effective batch - processing allocation methods are proposed, which significantly reduce the completion time of the system.

Optimal Batch Allocation for Wireless Federated Learning

Optimize Scheduling of Federated Learning on Battery-powered Mobile Devices

Towards Efficient Scheduling of Federated Mobile Devices under Computational and Statistical Heterogeneity

Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning

Fast Convergence for Federated Learning in OFDMA Systems

Resource Allocation for Multi-Task Federated Learning Algorithm over Wireless Communication Networks

Research on Resource Allocation for Efficient Federated Learning

Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning

Bandwidth Allocation for Federated Learning with Wireless Providers and Cost Constraints

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Delay Minimization for Federated Learning Over Wireless Communication Networks

Joint User Association and Resource Allocation for Wireless Hierarchical Federated Learning with IID and Non-IID Data

Device Scheduling with Fast Convergence for Wireless Federated Learning

Client Selection and Bandwidth Allocation for Federated Learning: An Online Optimization Perspective

Adaptive Hierarchical Federated Learning Over Wireless Networks

Bandwidth Allocation for Multiple Federated Learning Services in Wireless Edge Networks

Communication-Efficient Device Scheduling for Federated Learning Using Stochastic Optimization

Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation

Time-triggered Federated Learning over Wireless Networks

Federated Learning over Wireless Networks: Optimization Model Design and Analysis

Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective