Abstract:The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making purposes. However, due to resource constraints, delay limitations, and privacy challenges, edge devices cannot offload their entire collected datasets to a cloud server for centrally training their ML models or inference purposes. To overcome these challenges, distributed learning and inference techniques have been proposed as a means to enable edge devices to collaboratively train ML models without raw data exchanges, thus reducing the communication overhead and latency as well as improving data privacy. However, deploying distributed learning over wireless networks faces several challenges including the uncertain wireless environment (e.g., dynamic channel and interference), limited wireless resources (e.g., transmit power and radio spectrum), and hardware resources (e.g., computational power). This paper provides a comprehensive study of how distributed learning can be efficiently and effectively deployed over wireless edge networks. We present a detailed overview of several emerging distributed learning paradigms, including federated learning, federated distillation, distributed inference, and multi-agent reinforcement learning. For each learning framework, we first introduce the motivation for deploying it over wireless networks. Then, we present a detailed literature review on the use of communication techniques for its efficient deployment. We then introduce an illustrative example to show how to optimize wireless networks to improve its performance. Finally, we introduce future research opportunities. In a nutshell, this paper provides a holistic set of guidelines on how to deploy a broad range of distributed learning frameworks over real-world wireless communication networks.

Distributed Learning for Wireless Communications: Methods, Applications and Challenges

Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications

Distributed Learning in Wireless Networks: Recent Progress and Future Challenges

Brief Announcement: Data Dissemination in Unified Dynamic Wireless Networks

Decentralized learning for wireless communications and networking

Distributed Intelligence in Wireless Networks

Distributed Learning for Time-varying Networks: A Scalable Design

Scalable Learning Paradigms for Data-Driven Wireless Communication

Distributed Learning Systems with First-order Methods

Applications of Distributed Machine Learning for the Internet-of-Things: A Comprehensive Survey

Federated Learning and Wireless Communications

Learn to Sense: a Meta-learning Based Distributed Sensing Algorithm in Wireless Sensor Networks

Decentralized Edge Learning via Unreliable Device-to-Device Communications

Asynchronous Federated Learning over Wireless Communication Networks.

Guest Editorial: Communication Technologies for Efficient Edge Learning

Distributed Machine Learning in D2D-Enabled Heterogeneous Networks: Architectures, Performance, and Open Challenges

Communication-Efficient Distributed Deep Learning: A Comprehensive Survey

Machine Learning for Wireless Communication: An Overview

Deep Learning for Wireless Communications: An Emerging Interdisciplinary Paradigm

Towards Efficient Communications in Federated Learning: A Contemporary Survey

Distributed Learning Meets 6G: A Communication and Computing Perspective