Abstract:By deploying machine-learning algorithms at the network edge, edge learning can leverage the enormous real-time data generated by billions of mobile devices to train AI models, which enable intelligent mobile applications. In this emerging research area, one key direction is to efficiently utilize radio resources for wireless data acquisition to minimize the latency of executing a learning task at an edge server. Along this direction, we consider the specific problem of retransmission decision in each communication round to ensure both reliability and quantity of those training data for accelerating model convergence. To solve the problem, a new retransmission protocol called data-importance aware automatic-repeat-request (importance ARQ) is proposed. Unlike the classic ARQ focusing merely on reliability, importance ARQ selectively retransmits a data sample based on its uncertainty which helps learning and can be measured using the model under training. Underpinning the proposed protocol is a derived elegant communication-learning relation between two corresponding metrics, i.e., signal-to-noise ratio (SNR) and data uncertainty. This relation facilitates the design of a simple threshold based policy for importance ARQ. The policy is first derived based on the classic classifier model of support vector machine (SVM), where the uncertainty of a data sample is measured by its distance to the decision boundary. The policy is then extended to the more complex model of convolutional neural networks (CNN) where data uncertainty is measured by entropy. Extensive experiments have been conducted for both the SVM and CNN using real datasets with balanced and imbalanced distributions. Experimental results demonstrate that importance ARQ effectively copes with channel fading and noise in wireless data acquisition to achieve faster model convergence than the conventional channel-aware ARQ. The gain is more significant when the dataset is imbalanced.

Revisiting Analog Over-the-Air Machine Learning: The Blessing and Curse of Interference

Analog Gradient Aggregation for Federated Learning Over Wireless Networks: Customized Design and Convergence Analysis

Edge Intelligence Over the Air: Two Faces of Interference in Federated Learning

Federated Learning over Wireless Fading Channels

Decentralized Edge Learning via Unreliable Device-to-Device Communications

Over-the-air Learning Rate Optimization for Federated Learning

One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis

To Supervise or Not: How to Effectively Learn Wireless Interference Management Models?

Pruning Analog Over-the-Air Distributed Learning Models with Accuracy Loss Guarantee

Over-the-Air Federated Learning and Optimization

Unleashing Edgeless Federated Learning With Analog Transmissions

Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures

Online Power Control for Distributed Multitask Learning Over Noisy Fading Wireless Channels

One-Bit Byzantine-Tolerant Distributed Learning via Over-the-Air Computation

Convergence Analysis and Optimization of Over-the-Air Federated Meta-Learning.

Model Pruning for Distributed Learning over the Air

Approaching Globally Optimal Energy Efficiency in Interference Networks via Machine Learning

An Efficient Distributed Machine Learning Framework in Wireless D2D Networks: Convergence Analysis and System Implementation

Wireless Data Acquisition for Edge Learning: Data-Importance Aware Retransmission

Robust Federated Learning Over the Air: Combating Heavy-Tailed Noise with Median Anchored Clipping

Integrated Sensing and Learning for Better Generalized Edge AI