Abstract:In this paper, the performance optimization of federated learning (FL), when deployed over a realistic wireless multiple-input multiple-output (MIMO) communication system with digital modulation and over-the-air computation (AirComp) is studied. In particular, a MIMO system is considered in which edge devices transmit their local FL models (trained using their locally collected data) to a parameter server (PS) using beamforming to maximize the number of devices scheduled for transmission. The PS, acting as a central controller, generates a global FL model using the received local FL models and broadcasts it back to all devices. Due to the limited bandwidth in a wireless network, AirComp is adopted to enable efficient wireless data aggregation. However, fading of wireless channels can produce aggregate distortions in an AirComp-based FL scheme. To tackle this challenge, we propose a modified federated averaging (FedAvg) algorithm that combines digital modulation with AirComp to mitigate wireless fading while ensuring the communication efficiency. This is achieved by a joint transmit and receive beamforming design, which is formulated as an optimization problem to dynamically adjust the beamforming matrices based on current FL model parameters so as to minimize the transmitting error and ensure the FL performance. To achieve this goal, we first analytically characterize how the beamforming matrices affect the performance of the FedAvg in different iterations. Based on this relationship, an artificial neural network (ANN) is used to estimate the local FL models of all devices and adjust the beamforming matrices at the PS for future model transmission. The algorithmic advantages and improved performance of the proposed methodologies are demonstrated through extensive numerical experiments.

Joint Optimization for Federated Learning over the Air

Joint Optimization of Communications and Federated Learning over the Air

Joint Device Selection and Power Control for Wireless Federated Learning

Optimized Device Selection and Power Control for Wireless Federated Learning.

Joint Power Control and Data Size Selection for Over-the-Air Computation Aided Federated Learning

Convergence Analysis and Optimization of Over-the-Air Federated Meta-Learning.

Over-the-Air Federated Learning and Optimization

Joint Sparsification and Quantization for Heterogeneous Devices in Energy Constrained Federated Learning

Online Optimization for Over-the-Air Federated Learning with Energy Harvesting

A Joint Learning and Communications Framework for Federated Learning over Wireless Networks

Deep Reinforcement Learning for Energy Efficiency Maximization in SWIPT-Based Over-the-Air Federated Learning

Over-the-Air Federated Learning with Joint Adaptive Computation and Power Control

Joint Optimization of Convergence and Latency for Hierarchical Federated Learning over Wireless Networks

Digital Over-the-Air Federated Learning in Multi-Antenna Systems

Communication-efficient Federated Learning Through 1-Bit Compressive Sensing and Analog Aggregation.

Movable Antenna-Aided Federated Learning with Over-the-Air Aggregation: Joint Optimization of Positioning, Beamforming, and User Selection

Joint Receiver Design and User Scheduling for Over-the-Air Aggregation in Federated Learning

Age-Based Device Selection and Transmit Power Optimization in Over-the-Air Federated Learning

Convergence Analysis and Optimization of SWIPT-Based Over-the-Air Federated Learning

Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation

Adaptive Transceiver Design for Wireless Hierarchical Federated Learning