Abstract:Over-the-air federated learning (OTA-FL) is an emerging technique to reduce the computation and communication overload at the PS caused by the orthogonal transmissions of the model updates in conventional federated learning (FL). This reduction is achieved at the expense of introducing aggregation error that can be efficiently suppressed by means of receive beamforming via large array-antennas. This paper studies OTA-FL in massive multiple-input multiple-output (MIMO) systems by considering a realistic scenario in which the edge server, despite its large antenna array, is restricted in the number of radio frequency (RF)-chains. For this setting, the beamforming for over-the-air model aggregation needs to be addressed jointly with antenna selection. This leads to an NP-hard problem due to the combinatorial nature of the optimization. We tackle this problem via two different approaches. In the first approach, we use the penalty dual decomposition (PDD) technique to develop a two-tier algorithm for joint antenna selection and beamforming. The second approach interprets the antenna selection task as a sparse recovery problem and develops two iterative joint algorithms based on the Lasso and fast iterative soft-thresholding methods. Convergence and complexity analysis is presented for all the schemes. The numerical investigations depict that the algorithms based on the sparse recovery techniques outperform the PDD-based algorithm, when the number of RF-chains at the edge server is much smaller than its array size. However, as the number of RF-chains increases, the PDD approach starts to be superior. Our simulations further depict that learning performance with all the antennas being active at the PS can be closely tracked by selecting less than 20% of the antennas at the PS.

Joint Power Control and Data Size Selection for Over-the-Air Computation Aided Federated Learning

Joint Optimization for Federated Learning over the Air

Resource Allocation for Multi-Task Federated Learning Algorithm over Wireless Communication Networks

Joint Optimization of Communications and Federated Learning over the Air

Joint Device Selection and Power Control for Wireless Federated Learning

Movable Antenna-Aided Federated Learning with Over-the-Air Aggregation: Joint Optimization of Positioning, Beamforming, and User Selection

Joint User Association and Resource Allocation for Wireless Hierarchical Federated Learning with IID and Non-IID Data

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Over-the-Air Federated Learning with Joint Adaptive Computation and Power Control

Energy and Spectrum Efficient Federated Learning via High-Precision Over-the-Air Computation

Federated Learning via Over-the-Air Computation

Over-the-Air Federated Learning and Optimization

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

Cost-Aware Hierarchical Federated Learning via Over-the-Air Computing

Energy Minimization for Federated Learning with IRS-Assisted Over-the-Air Computation

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

User Scheduling for Federated Learning Through Over-the-Air Computation

Joint Antenna Selection and Beamforming for Massive MIMO-enabled Over-the-Air Federated Learning

Optimized Device Selection and Power Control for Wireless Federated Learning.

Device Scheduling for Relay-assisted Over-the-Air Aggregation in Federated Learning