Abstract:We consider a broadband over-the-air computation empowered model aggregation approach for wireless federated learning (FL) systems and propose to leverage an intelligent reflecting surface (IRS) to combat wireless fading and noise. We first investigate the conventional node-selection based framework, where a few edge nodes are dropped in model aggregation to control the aggregation error. We analyze the performance of this node-selection based framework and derive an upper bound on its performance loss, which is shown to be related to the selected edge nodes. Then, we seek to minimize the mean-squared error (MSE) between the desired global gradient parameters and the actually received ones by optimizing the selected edge nodes, their transmit equalization coefficients, the IRS phase shifts, and the receive factors of the cloud server. By resorting to the matrix lifting technique and difference-of-convex programming, we successfully transform the formulated optimization problem into a convex one and solve it using off-the-shelf solvers. To improve learning performance, we further propose a weight-selection based FL framework. In such a framework, we assign each edge node a proper weight coefficient in model aggregation instead of discarding any of them to reduce the aggregation error, i.e., amplitude alignment of the received local gradient parameters from different edge nodes is not required. We also analyze the performance of this weight-selection based framework and derive an upper bound on its performance loss, followed by minimizing the MSE via optimizing the weight coefficients of the edge nodes, their transmit equalization coefficients, the IRS phase shifts, and the receive factors of the cloud server. Furthermore, we use the MNIST dataset for simulations to evaluate the performance of both node-selection and weight-selection based FL frameworks.

Random Aggregate Beamforming for Over-the-Air Federated Learning in Large-Scale Networks

Random Aggregate Beamforming for Over-the-Air Federated Learning in Large-Scale Networks

Beamforming and Device Selection Design in Federated Learning with Over-the-air Aggregation

Enabling Efficient Scheduling Policy in Intelligent Reflecting Surface Aided Federated Learning

Federated Learning via Over-the-Air Computation

Movable Antenna-Aided Federated Learning with Over-the-Air Aggregation: Joint Optimization of Positioning, Beamforming, and User Selection

Digital Over-the-Air Federated Learning in Multi-Antenna Systems

Over-the-air Learning Rate Optimization for Federated Learning

Federated Learning via Intelligent Reflecting Surface

Joint Antenna Selection and Beamforming for Massive MIMO-enabled Over-the-Air Federated Learning

Jamming-Resilient Over-the-Air Computation for Federated Learning in Edge Intelligence.

IRS Assisted Federated Learning A Broadband Over-the-Air Aggregation Approach

Over-the-Air Federated Learning and Optimization

IRS Assisted Federated Learning: A Broadband Over-the-Air Aggregation Approach

Deploying Federated Learning in Large-Scale Cellular Networks: Spatial Convergence Analysis

Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning

Over-The-Air Federated Learning Over Scalable Cell-free Massive MIMO

Over-the-Air Decentralized Federated Learning under MIMO Noisy Channel

Probabilistic Device Scheduling for Over-the-Air Federated Learning

Over-The-Air Federated Learning: Status Quo, Open Challenges, and Future Directions