Abstract:We consider a broadband over-the-air computation empowered model aggregation approach for wireless federated learning (FL) systems and propose to leverage an intelligent reflecting surface (IRS) to combat wireless fading and noise. We first investigate the conventional node-selection based framework, where a few edge nodes are dropped in model aggregation to control the aggregation error. We analyze the performance of this node-selection based framework and derive an upper bound on its performance loss, which is shown to be related to the selected edge nodes. Then, we seek to minimize the mean-squared error (MSE) between the desired global gradient parameters and the actually received ones by optimizing the selected edge nodes, their transmit equalization coefficients, the IRS phase shifts, and the receive factors of the cloud server. By resorting to the matrix lifting technique and difference-of-convex programming, we successfully transform the formulated optimization problem into a convex one and solve it using off-the-shelf solvers. To improve learning performance, we further propose a weight-selection based FL framework. In such a framework, we assign each edge node a proper weight coefficient in model aggregation instead of discarding any of them to reduce the aggregation error, i.e., amplitude alignment of the received local gradient parameters from different edge nodes is not required. We also analyze the performance of this weight-selection based framework and derive an upper bound on its performance loss, followed by minimizing the MSE via optimizing the weight coefficients of the edge nodes, their transmit equalization coefficients, the IRS phase shifts, and the receive factors of the cloud server. Furthermore, we use the MNIST dataset for simulations to evaluate the performance of both node-selection and weight-selection based FL frameworks.

Channel-Estimation-Free Gradient Aggregation for Over-the-Air SIMO Federated Learning

Analog Gradient Aggregation for Federated Learning Over Wireless Networks: Customized Design and Convergence Analysis

Message Passing Based Wireless Federated Learning Via Analog Message Aggregation

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Over-the-Air Federated Learning Over MIMO Channels: A Sparse-Coded Multiplexing Approach

Lazily Aggregated Quantized Gradient Innovation for Communication-Efficient Federated Learning.

Over-the-Air Federated Learning via Weighted Aggregation

One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis

IRS Assisted Federated Learning A Broadband Over-the-Air Aggregation Approach

IRS Assisted Federated Learning: A Broadband Over-the-Air Aggregation Approach

Channel and Gradient-Importance Aware Device Scheduling for Over-the-Air Federated Learning

Over-the-air Learning Rate Optimization for Federated Learning

Over-the-Air Federated Learning and Optimization

Over-the-Air Aggregation for Federated Learning: Waveform Superposition and Prototype Validation

Efficient Wireless Federated Learning via Low-Rank Gradient Factorization

Over-the-Air Federated Learning in MIMO Cloud-RAN Systems

Sparse Incremental Aggregation in Multi-Hop Federated Learning

Federated Learning via Over-the-Air Computation

Data and Channel-Adaptive Sensor Scheduling for Federated Edge Learning via Over-the-Air Gradient Aggregation

Boosting Communication Efficiency of Federated Learning's Secure Aggregation

Semi-Asynchronous Federated Edge Learning for Over-the-Air Computation