Abstract:Over-the-air federated learning (OTA-FL) is an emerging technique to reduce the computation and communication overload caused by the orthogonal transmissions of the model updates in conventional federated learning (FL). This reduction is achieved at the expense of introducing aggregation error that can be efficiently suppressed by means of receive beamforming via large array-antennas. This paper studies OTA-FL in massive multiple-input multiple-output (MIMO) systems with limited number of radio frequency (RF)-chains. For this setting, the beamforming for over-the-air model aggregation needs to be addressed jointly with antenna selection. This leads to an NP-hard problem due to its combinatorial nature. We develop three different algorithms to solve the problem. First, we use the penalty dual decomposition (PDD) technique and propose a two-tier algorithm for joint antenna selection and beamforming. The second algorithm interprets the antenna selection task as a sparse recovery problem and invokes the least absolute shrinkage and selection operator (Lasso) algorithm to approximate the sparse solution. The third algorithm invokes the same sparse recovery based interpretation, but employs the low-complexity method of fast iterative soft-thresholding to find a sparse solution. Convergence and complexity analysis is presented for all the algorithms. The numerical investigations depict that the two algorithms based on the sparse recovery interpretation outperform the PDD-based algorithm, when the number of RF-chains at the edge server is much smaller than its array size. However, as the number of RF-chains increases, the PDD-based algorithm outperforms. Our simulations further depict that learning performance with all the antennas being active at the parameter server (PS) can be closely tracked by selecting less than 20% of the antennas at the PS.

Joint Receiver Design and User Scheduling for Over-the-Air Aggregation in Federated Learning

Resource Allocation for Multi-Task Federated Learning Algorithm over Wireless Communication Networks

User Scheduling for Federated Learning Through Over-the-Air Computation

Movable Antenna-Aided Federated Learning with Over-the-Air Aggregation: Joint Optimization of Positioning, Beamforming, and User Selection

Beamforming and Device Selection Design in Federated Learning with Over-the-air Aggregation

Joint Downlink-Uplink Beamforming for Wireless Multi-Antenna Federated Learning

Channel and Gradient-Importance Aware Device Scheduling for Over-the-Air Federated Learning

Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning

Device Scheduling for Relay-assisted Over-the-Air Aggregation in Federated Learning

Joint User Scheduling and Beam Selection Optimization for Beam-Based Massive MIMO Downlinks

Joint User Association and Resource Allocation for Wireless Hierarchical Federated Learning with IID and Non-IID Data

Joint Antenna Selection and Beamforming for Massive MIMO-enabled Over-the-Air Federated Learning

Asynchronous Federated Learning over Wireless Communication Networks.

Random Aggregate Beamforming for Over-the-Air Federated Learning in Large-Scale Networks

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

Joint User Cooperation and Scheduling for Federated Learning in CFmMIMO Networks

QoS-Constrained Federated Learning Empowered by Intelligent Reflecting Surface

Quantization Bits Allocation for Wireless Federated Learning

Over-the-Air Computation Empowered Federated Learning: A Joint Uplink-Downlink Design

Simultaneous Federated Learning and Information Transmission over Time-Varying MIMO Channels.