Abstract:Millimeter wave (mmWave) communication has attracted extensive attention and research due to its wide bandwidth and abundant spectrum resources. Effective and fast beam tracking is a critical challenge for the practical deployment of mmWave communications. Existing studies demonstrate the potential of sensing-aided beam tracking. However, most studies are focus on single-modal data assistance without considering multi-modal calibration or the impact of inference latency of different sub-modules. Thus, in this study, we design a decision-level multi-modal (mmWave received signal power vector, RGB image and GPS data) fusion for sensing-aided beam tracking (DMBT) method. The proposed DMBT method includes three designed mechanisms, namely normal prediction process, beam misalignment alert and beam tracking correction. The normal prediction process conducts partial beam training instead of exhaustive beam training, which largely reduces large beam training overhead. It also comprehensively selects prediction results from multi-modal data to enhance the DMBT method robustness to noise. The beam misalignment alert based on RGB image and GPS data detects whether there exists beam misalignment and also predict the optimal beam. The beam tracking correction is designed to capture the optimal beam if misalignment happens by reusing certain blocks in normal prediction process and possibly outdated prediction results. Finally, we evaluate the proposed DMBT method in the vehicle-to-infrastructure scenario based on a real-world dataset. The results show that the method is capable of self-correction and mitigating the negative effect of the relative inference latency. Moreover, 75%–93% beam training overhead can be saved to maintain reliable communication even when faced with considerable noise in measurement data.

Machine Learning-Based mmWave MIMO Beam Tracking in V2I Scenarios: Algorithms and Datasets

5G MIMO Data for Machine Learning: Application to Beam-Selection using Deep Learning

Beam Profiling and Beamforming Modeling for mmWave NextG Networks

Millimetre-Wave Beam Tracking: an Intelligent Machine Learning and Kalman Filter Fusion Technology

A Deep Learning Approach to Location- and Orientation-aided 3D Beam Selection for mmWave Communications

Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios

Machine Learning (ML)-assisted Beam Management in millimeter (mm)Wave Distributed Multiple Input Multiple Output (D-MIMO) systems

Machine-Learning Beam Tracking and Weight Optimization for mmWave Multi-UAV Links

Machine-learning-aided method for optimizing beam selection and update period in 5G networks and beyond

ViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutions

Vision-Position Multi-Modal Beam Prediction Using Real Millimeter Wave Datasets

Machine Learning Enabling Analog Beam Selection for Concurrent Transmissions in Millimeter-Wave V2V Communications

Multi-modal fusion for sensing-aided beam tracking in mmWave communications

Machine Learning Techniques for Blind Beam Alignment in mmWave Massive MIMO

Going Beyond RF: How AI-enabled Multimodal Beamforming will Shape the NextG Standard

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstration

LIDAR Data for Deep Learning-Based mmWave Beam-Selection

LSTM-Aided Selective Beam Tracking in Multi-Cell Scenario for mmWave Wireless Systems

Beam Training in mmWave Vehicular Systems: Machine Learning for Decoupling Beam Selection

Tracking Position and Orientation Through Millimeter Wave Lens MIMO in 5G Systems