Abstract:Federated learning (FL), as an emerging distributed machine learning paradigm, allows a mass of edge devices to collaboratively train a global model while preserving privacy. In this tutorial, we focus on FL via over-the-air computation (AirComp), which is proposed to reduce the communication overhead for FL over wireless networks at the cost of compromising in the learning performance due to model aggregation error arising from channel fading and noise. We first provide a comprehensive study on the convergence of AirComp-based FedAvg (AirFedAvg) algorithms under both strongly convex and non-convex settings with constant and diminishing learning rates in the presence of data heterogeneity. Through convergence and asymptotic analysis, we characterize the impact of aggregation error on the convergence bound and provide insights for system design with convergence guarantees. Then we derive convergence rates for AirFedAvg algorithms for strongly convex and non-convex objectives. For different types of local updates that can be transmitted by edge devices (i.e., local model, gradient, and model difference), we reveal that transmitting local model in AirFedAvg may cause divergence in the training procedure. In addition, we consider more practical signal processing schemes to improve the communication efficiency and further extend the convergence analysis to different forms of model aggregation error caused by these signal processing schemes. Extensive simulation results under different settings of objective functions, transmitted local information, and communication schemes verify the theoretical conclusions.

Unleashing Edgeless Federated Learning With Analog Transmissions

Message Passing Based Wireless Federated Learning Via Analog Message Aggregation

Federated Learning with Unsourced Random Access.

Asynchronous Federated Learning over Wireless Communication Networks.

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

FedLC: Accelerating Asynchronous Federated Learning in Edge Computing

Edge Federated Learning Via Unit-Modulus Over-The-Air Computation

Adaptive Asynchronous Federated Learning in Resource-Constrained Edge Computing

Quantized Federated Learning under Transmission Delay and Outage Constraints

Over-the-Air Federated Learning and Optimization

Decentralized Federated Learning with Data Feature Transmission and Neighbor Selection.

Over-the-Air Computation Empowered Federated Learning: A Joint Uplink-Downlink Design

Confederated Learning: Federated Learning with Decentralized Edge Servers

To Talk or to Work: Delay Efficient Federated Learning over Mobile Edge Devices

FedHe: Heterogeneous Models and Communication-Efficient Federated Learning

Adaptive Transceiver Design for Wireless Hierarchical Federated Learning

No One Idles: Efficient Heterogeneous Federated Learning with Parallel Edge and Server Computation.

Digital versus Analog Transmissions for Federated Learning over Wireless Networks

Deploying Federated Learning in Large-Scale Cellular Networks: Spatial Convergence Analysis

Edge Intelligence Over the Air: Two Faces of Interference in Federated Learning

Asynchronous Decentralized Federated Learning for Heterogeneous Devices