Abstract:Incorporating artificial intelligence and machine learning (AI/ML) methods within the 5G wireless standard promises autonomous network behavior and ultra-low-latency reconfiguration. However, the effort so far has purely focused on learning from radio frequency (RF) signals. Future standards and next-generation (nextG) networks beyond 5G will have two significant evolutions over the state-of-the-art 5G implementations: (i) massive number of antenna elements, scaling up to hundreds-to-thousands in number, and (ii) inclusion of AI/ML in the critical path of the network reconfiguration process that can access sensor feeds from a variety of RF and non-RF sources. While the former allows unprecedented flexibility in 'beamforming', where signals combine constructively at a target receiver, the latter enables the network with enhanced situation awareness not captured by a single and isolated data modality. This survey presents a thorough analysis of the different approaches used for beamforming today, focusing on mmWave bands, and then proceeds to make a compelling case for considering non-RF sensor data from multiple modalities, such as LiDAR, Radar, GPS for increasing beamforming directional accuracy and reducing processing time. This so called idea of multimodal beamforming will require deep learning based fusion techniques, which will serve to augment the current RF-only and classical signal processing methods that do not scale well for massive antenna arrays. The survey describes relevant deep learning architectures for multimodal beamforming, identifies computational challenges and the role of edge computing in this process, dataset generation tools, and finally, lists open challenges that the community should tackle to realize this transformative vision of the future of beamforming.

5G MIMO Data for Machine Learning: Application to Beam-Selection using Deep Learning

Machine Learning-Based mmWave MIMO Beam Tracking in V2I Scenarios: Algorithms and Datasets

A Deep Learning Framework for Adaptive Beamforming in Massive MIMO Millimeter Wave 5G Multicellular Networks

Deep Learning-Based Mmwave Beam Selection for 5G NR/6G with Sub-6 GHz Channel Information: Algorithms and Prototype Validation

Machine Learning (ML)-assisted Beam Management in millimeter (mm)Wave Distributed Multiple Input Multiple Output (D-MIMO) systems

Compressed Beam Selection for Single/multi-cell Beam Management

Deep Learning based Channel Estimation and Hybrid Beamforming for 5G Massive MIMO Wireless Communications

Machine-learning-aided method for optimizing beam selection and update period in 5G networks and beyond

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Machine Learning at the Edge: A Data-Driven Architecture With Applications to 5G Cellular Networks

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Network

Machine Learning Based Beam Selection With Low Complexity Hybrid Beamforming Design for 5G Massive MIMO Systems

Fast MIMO Beamforming via Deep Reinforcement Learning for High Mobility mmWave Connectivity

Deep Learning for Near-Field XL-MIMO Transceiver Design: Principles and Techniques

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Deep Learning for Mmwave Beam-Management: State-of-the-Art, Opportunities and Challenges

Going Beyond RF: How AI-enabled Multimodal Beamforming will Shape the NextG Standard

LIDAR Data for Deep Learning-Based mmWave Beam-Selection

A Low-Complexity Machine Learning Design for mmWave Beam Prediction

Transfer Reinforcement Learning for 5G-NR mm-Wave Networks