Abstract:We study federated machine learning at the wireless network edge, where limited power wireless devices, each with its own dataset, build a joint model with the help of a remote parameter server (PS). We consider a bandwidth-limited fading multiple access channel (MAC) from the wireless devices to the PS, and propose various techniques to implement distributed stochastic gradient descent (DSGD). We first propose a digital DSGD (D-DSGD) scheme, in which one device is selected opportunistically for transmission at each iteration based on the channel conditions; the scheduled device quantizes its gradient estimate to a finite number of bits imposed by the channel condition, and transmits these bits to the PS in a reliable manner. Next, motivated by the additive nature of the wireless MAC, we propose a novel analog communication scheme, referred to as the compressed analog DSGD (CA-DSGD), where the devices first sparsify their gradient estimates while accumulating error, and project the resultant sparse vector into a low-dimensional vector for bandwidth reduction. Numerical results show that D-DSGD outperforms other digital approaches in the literature; however, in general the proposed CA-DSGD algorithm converges faster than the D-DSGD scheme and other schemes in the literature, and reaches a higher level of accuracy. We have observed that the gap between the analog and digital schemes increases when the datasets of devices are not independent and identically distributed (i.i.d.). Furthermore, the performance of the CA-DSGD scheme is shown to be robust against imperfect channel state information (CSI) at the devices. Overall these results show clear advantages for the proposed analog over-the-air DSGD scheme, which suggests that learning and communication algorithms should be designed jointly to achieve the best end-to-end performance in machine learning applications at the wireless edge.

Learning to Detect Frame Synchronization.

ELM-Based Frame Synchronization in Burst-Mode Communication Systems with Nonlinear Distortion

Deep Learning-based Frame and Timing Synchronization for End-to-End Communications

Blind Recognition of Frame Synchronization Based on Deep Learning

Frame Synchronization with Parallel Multiple Delay Correlations in Low SNR Environments

Frame Synchronization Word Identification of Link Layer Protocol Based on Multi-fractal Spectrum

Synchronization Signal Identification and Parameter Estimation Based on Delay Autocorrelation Method

A Novel Approach of Frame Synchronization in Presence of Frequency Offset

MLE-based Device Activity Detection under Rician Fading for Massive Grant-free Access with Perfect and Imperfect Synchronization

Frame Synchronization in SC-FDE System Using PN Sequence Modulation

Frame Synchronization Algorithm Based on Adaptive Dual- Threshold Decision

Asynchronous Detection for Machine-to-machine Systems with Code Division Multiple Access.

An Improved Frame Synchronization Method Based on Correlation Window Division

A frame synchronization method for underwater acoustic communication on mobile platform

Method of Parallel Input and Parallel AOS Frame Synchronization Detection Based on FPGA

Algorithm and Performance Analysis for Frame Detection Based on Matched Filtering

Federated Learning over Wireless Fading Channels

Frame Arrival Detection for Low SNR Frequency Selective Fading Channels

Customized Joint Blind Frame Synchronization and Decoding Methods for Analog LDPC Decoder

Frame Synchronization Algorithm in Energy-Efficient Data Transmission System