Abstract:Leveraging sensory information to aid the millimeter-wave (mmWave) and sub-terahertz (sub-THz) beam selection process is attracting increasing interest. This sensory data, captured for example by cameras at the basestations, has the potential of significantly reducing the beam sweeping overhead and enabling highly-mobile applications. The solutions developed so far, however, have mainly considered single-candidate scenarios, i.e., scenarios with a single candidate user in the visual scene, and were evaluated using synthetic datasets. To address these limitations, this paper extensively investigates the sensing-aided beam prediction problem in a real-world multi-object vehicle-to-infrastructure (V2I) scenario and presents a comprehensive machine learning-based framework. In particular, this paper proposes to utilize visual and positional data to predict the optimal beam indices as an alternative to the conventional beam sweeping approaches. For this, a novel user (transmitter) identification solution has been developed, a key step in realizing sensing-aided multi-candidate and multi-user beam prediction solutions. The proposed solutions are evaluated on the large-scale real-world DeepSense $6$G dataset. Experimental results in realistic V2I communication scenarios indicate that the proposed solutions achieve close to $100\%$ top-5 beam prediction accuracy for the scenarios with single-user and close to $95\%$ top-5 beam prediction accuracy for multi-candidate scenarios. Furthermore, the proposed approach can identify the probable transmitting candidate with more than $93\%$ accuracy across the different scenarios. This highlights a promising approach for nearly eliminating the beam training overhead in mmWave/THz communication systems.

A Low-Complexity Machine Learning Design for mmWave Beam Prediction

A Low-Complexity Machine Learning Design for mmWave Beam Prediction

Enhancing Mmwave Beam Prediction Through Deep Learning with Sub-6 GHz Channel Estimate

Best Beam Prediction in Non-Standalone Mm Wave Systems

Machine Learning (ML)-assisted Beam Management in millimeter (mm)Wave Distributed Multiple Input Multiple Output (D-MIMO) systems

Machine-learning-aided method for optimizing beam selection and update period in 5G networks and beyond

Machine Learning Based Beam Selection With Low Complexity Hybrid Beamforming Design for 5G Massive MIMO Systems

Deep Learning-Based Mmwave Beam Selection for 5G NR/6G with Sub-6 GHz Channel Information: Algorithms and Prototype Validation

A Deep Learning Framework for Adaptive Beamforming in Massive MIMO Millimeter Wave 5G Multicellular Networks

5G-Advanced AI/ML Beam Management: Performance Evaluation with Integrated ML Models

Deep Learning Assisted Mmwave Beam Prediction with Prior Low-frequency Information

Efficient Millimeter-Wave Beam Prediction: an WiFi Sensing-Assisted Deep Learning Approach

Machine Learning for Beam Alignment in Millimeter Wave Massive MIMO

Machine Learning Techniques for Blind Beam Alignment in mmWave Massive MIMO

Deep Learning Assisted Beam Prediction Using Out-of-Band Information.

Machine Learning Prediction for Phase-less Millimeter-Wave Beam Tracking

Machine Learning Enabling Analog Beam Selection for Concurrent Transmissions in Millimeter-Wave V2V Communications

Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios

Beam Training in mmWave Vehicular Systems: Machine Learning for Decoupling Beam Selection

Beam Profiling and Beamforming Modeling for mmWave NextG Networks

Machine Learning for Reliable mmWave Systems: Blockage Prediction and Proactive Handoff