Abstract:Leveraging sensory information to aid the millimeter-wave (mmWave) and sub-terahertz (sub-THz) beam selection process is attracting increasing interest. This sensory data, captured for example by cameras at the basestations, has the potential of significantly reducing the beam sweeping overhead and enabling highly-mobile applications. The solutions developed so far, however, have mainly considered single-candidate scenarios, i.e., scenarios with a single candidate user in the visual scene, and were evaluated using synthetic datasets. To address these limitations, this paper extensively investigates the sensing-aided beam prediction problem in a real-world multi-object vehicle-to-infrastructure (V2I) scenario and presents a comprehensive machine learning-based framework. In particular, this paper proposes to utilize visual and positional data to predict the optimal beam indices as an alternative to the conventional beam sweeping approaches. For this, a novel user (transmitter) identification solution has been developed, a key step in realizing sensing-aided multi-candidate and multi-user beam prediction solutions. The proposed solutions are evaluated on the large-scale real-world DeepSense $6$G dataset. Experimental results in realistic V2I communication scenarios indicate that the proposed solutions achieve close to $100\%$ top-5 beam prediction accuracy for the scenarios with single-user and close to $95\%$ top-5 beam prediction accuracy for multi-candidate scenarios. Furthermore, the proposed approach can identify the probable transmitting candidate with more than $93\%$ accuracy across the different scenarios. This highlights a promising approach for nearly eliminating the beam training overhead in mmWave/THz communication systems.

3D Scene Based Beam Selection for Mmwave Communications

Enhancing Mmwave Beam Prediction Through Deep Learning with Sub-6 GHz Channel Estimate

A Deep Learning Approach to Location- and Orientation-aided 3D Beam Selection for mmWave Communications

Vision Aided Environment Semantics Extraction and Its Application in Mmwave Beam Selection

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Compressed Beam Selection for Single/multi-cell Beam Management

Multimodal Deep Learning Empowered Millimeter-Wave Beam Prediction

Beam Selection and Power Allocation: Using Deep Learning for Sensing-Assisted Communication

Third-party Camera Aided Beam Alignment Real-world Prototype for Mmwave Communications

Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios

Deep Learning Assisted Beam Prediction Using Out-of-Band Information.

LIDAR Data for Deep Learning-Based mmWave Beam-Selection

Deep Learning Assisted Mmwave Beam Prediction with Prior Low-frequency Information

Multi-Camera Views Based Beam Searching and BS Selection with Reduced Training Overhead

Environment Semantics Aided Wireless Communications: A Case Study of mmWave Beam Prediction and Blockage Prediction

Deep Learning-Based Mmwave Beam Selection for 5G NR/6G with Sub-6 GHz Channel Information: Algorithms and Prototype Validation

Deep Learning for Hierarchical Beam Alignment in mmWave Communication Systems

Deep Learning Assisted mmWave Beam Prediction for Heterogeneous Networks: A Dual-Band Fusion Approach

Deep Learning for Mmwave Beam-Management: State-of-the-Art, Opportunities and Challenges

Vision-Assisted mmWave Beam Management for Next-Generation Wireless Systems: Concepts, Solutions and Open Challenges

DNN Based Beam Selection in mmW Heterogeneous Networks