Abstract:Over-the-air federated edge learning (Air-FEEL) has emerged as a communication-efficient solution to enable distributed machine learning over edge devices by using their data locally to preserve the privacy. By exploiting the waveform superposition property of wireless channels, Air-FEEL allows the “one-shot” over-the-air aggregation of gradient-updates to enhance the communication efficiency, but at the cost of a compromised learning performance due to the aggregation errors caused by channel fading and noise. This paper investigates the transmission power control to combat against such aggregation errors in Air-FEEL. Different from conventional power control designs (e.g., to minimize the individual mean squared error (MSE) of the over-the-air aggregation at each round), we consider a new power control design aiming at directly maximizing the convergence speed. Towards this end, we first analyze the convergence behavior of Air-FEEL (in terms of the optimality gap) subject to aggregation errors at different communication rounds. It is revealed that if the aggregation estimates are unbiased, then the training algorithm would converge exactly to the optimal point with mild conditions; while if they are biased, then the algorithm would converge with an error floor determined by the accumulated estimate bias over communication rounds. Next, building upon the convergence results, we optimize the power control to directly minimize the derived optimality gaps under the cases without and with unbiased aggregation constraints, subject to a set of average and maximum power constraints at individual edge devices. We transform both problems into convex forms, and obtain their structured optimal solutions, both appearing in a form of regularized channel inversion, by using the Lagrangian duality method. Finally, numerical results show that the proposed power control policies achieve significantly faster convergence for Air-FEEL, as compared with benchmark policies with fixed power transmission or conventional MSE minimization.

Over-the-Air Federated Averaging with Limited Power and Privacy Budgets

Projected Federated Averaging with Heterogeneous Differential Privacy.

Private Federated Learning With Misaligned Power Allocation via Over-the-Air Computation

Over-the-Air Federated Learning with Joint Adaptive Computation and Power Control

Privacy-Enhanced Over-the-Air Federated Learning via Client-Driven Power Balancing

Toward Secure and Private Over-the-Air Federated Learning

Optimal Adaptive Power Control for Over-The-Air Federated Edge Learning under Fading Channels

Joint Communication and Learning Design of Differential Privacy for Federated Learning over Multi-cell Networks.

Mixed-Precision Federated Learning via Multi-Precision Over-The-Air Aggregation

Over-the-air Learning Rate Optimization for Federated Learning

Differentially Private Over-the-Air Federated Learning Over MIMO Fading Channels

Optimized Power Control for Privacy-Preserving Over-the-Air Federated Edge Learning With Device Sampling

Optimized Power Control Design for Over-the-Air Federated Edge Learning

Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control

Federated Learning via Over-the-Air Computation

Optimized Power Control for Over-the-Air Federated Edge Learning

Optimal Power Control for Over-The-Air Federated Edge Learning Using Statistical Channel Knowledge

Device Scheduling for Secure Aggregation in Wireless Federated Learning

Private Federated Learning with Dynamic Power Control via Non-Coherent Over-the-Air Computation

Channel and Gradient-Importance Aware Device Scheduling for Over-the-Air Federated Learning

Joint Antenna Selection and Beamforming for Massive MIMO-enabled Over-the-Air Federated Learning