Abstract:The stringent requirements for low-latency and privacy of the emerging high-stake applications with intelligent devices such as drones and smart vehicles make the cloud computing inapplicable in these scenarios. Instead, edge machine learning becomes increasingly attractive for performing training and inference directly at network edges without sending data to a centralized data center. This stimulates a nascent field termed as federated learning for training a machine learning model on computation, storage, energy and bandwidth limited mobile devices in a distributed manner. To preserve data privacy and address the issues of unbalanced and non-IID data points across different devices, the federated averaging algorithm has been proposed for global model aggregation by computing the weighted average of locally updated model at each selected device. However, the limited communication bandwidth becomes the main bottleneck for aggregating the locally computed updates. We thus propose a novel over-the-air computation based approach for fast global model aggregation via exploring the superposition property of a wireless multiple-access channel. This is achieved by joint device selection and beamforming design, which is modeled as a sparse and low-rank optimization problem to support efficient algorithms design. To achieve this goal, we provide a difference-of-convex-functions (DC) representation for the sparse and low-rank function to enhance sparsity and accurately detect the fixed-rank constraint in the procedure of device selection. A DC algorithm is further developed to solve the resulting DC program with global convergence guarantees. The algorithmic advantages and admirable performance of the proposed methodologies are demonstrated through extensive numerical results.

Coded Over-the-Air Computation for Model Aggregation in Federated Learning

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

Compute-Update Federated Learning: A Lattice Coding Approach Over-the-Air

Over-the-Air Federated Learning and Optimization

Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning

Cluster-Based Cooperative Digital Over-the-Air Aggregation for Wireless Federated Edge Learning

Robust Federated Learning Over the Air: Combating Heavy-Tailed Noise with Median Anchored Clipping

Federated Learning via Lattice Joint Source-Channel Coding

Federated Learning in Multi-RIS-Aided Systems

Scalable and Reliable Over-the-Air Federated Edge Learning

Federated Learning via Over-the-Air Computation

Over-the-air Learning Rate Optimization for Federated Learning

Byzantine-Resilient Federated Machine Learning via Over-the-Air Computation

Model Compression by Count-Sketch for Over-the-Air Stateless Federated Learning

Over-the-Air Computation Empowered Federated Learning: A Joint Uplink-Downlink Design

1-Bit Compressive Sensing for Efficient Federated Learning Over the Air

Over-the-Air Federated Learning via Weighted Aggregation

FedMDC: Enabling Communication-Efficient Federated Learning over Packet Lossy Networks Via Multiple Description Coding

Unsourced Massive Access-Based Digital Over-the-Air Computation for Efficient Federated Edge Learning

Federated Learning via Intelligent Reflecting Surface