Abstract:Deep learning (DL) has seen great success in the computer vision (CV) field, and related techniques have been used in security, healthcare, remote sensing, and many other fields. As a parallel development, visual data has become universal in daily life, easily generated by ubiquitous low-cost cameras. Therefore, exploring DL-based CV may yield useful information about objects, such as their number, locations, distribution, motion, etc. Intuitively, DL-based CV can also facilitate and improve the designs of wireless communications, especially in dynamic network scenarios. However, so far, such work is rare in the literature. The primary purpose of this article, then, is to introduce ideas about applying DL-based CV in wireless communications to bring some novel degrees of freedom to both theoretical research and engineering applications. To illustrate how DL-based CV can be applied in wireless communications, an example of using a DL-based CV with a millimeter-wave (mmWave) system is given to realize optimal mmWave multiple-input and multiple-output (MIMO) beamforming in mobile scenarios. In this example, we propose a framework to predict future beam indices from previously observed beam indices and images of street views using ResNet, 3-dimensional ResNext, and a long short-term memory network. The experimental results show that our frameworks achieve much higher accuracy than the baseline method, and that visual data can significantly improve the performance of the MIMO beamforming system. Finally, we discuss the opportunities and challenges of applying DL-based CV in wireless communications.

Deep Learning in Wireless Communications for Physical Layer

Deep Learning for Wireless Physical Layer: Opportunities and Challenges

Toward Intelligent Wireless Communications: Deep Learning - Based Physical Layer Technologies

Model-Driven Deep Learning for Physical Layer Communications

Deep Learning for Wireless Communications: An Emerging Interdisciplinary Paradigm

Deep learning in physical layer communications: Evolution and prospects in 5G and 6G networks

Deep Learning for Physical-Layer 5G Wireless Techniques: Opportunities, Challenges and Solutions

An Introduction to Deep Learning for the Physical Layer

An Overview of Wireless Transmission Technology Utilizing Artificial Intelligence

Deep Learning for Channel Estimation in Physical Layer Wireless Communications: Fundamental, Methods, and Challenges

To Learn or Not to Learn: Deep Learning Assisted Wireless Modem Design

Artificial Intelligence in Optical Communications: From Machine Learning to Deep Learning

Deep Learning Framework for Wireless Systems: Applications to Optical Wireless Communications

Research On Deep Learning Based End-To-End Wireless Communication System Technology

Science-Informed Deep Learning (ScIDL) With Applications to Wireless Communications

Theoretical Analysis of Deep Neural Networks in Physical Layer Communication

Aider: Artificial Intelligent Based Deep Receiver for Wireless Communication Systems

Fast Adaptation for Deep Learning-based Wireless Communications

AI Empowered Wireless Communications: from Bits to Semantics

Applying Deep-Learning-Based Computer Vision to Wireless Communications: Methodologies, Opportunities, and Challenges

Deep Learning in Physical Layer: Review on Data Driven End-to-End Communication Systems and their Enabling Semantic Applications