Abstract:Millimeter wave (mmWave) communication has attracted extensive attention and research due to its wide bandwidth and abundant spectrum resources. Effective and fast beam tracking is a critical challenge for the practical deployment of mmWave communications. Existing studies demonstrate the potential of sensing-aided beam tracking. However, most studies are focus on single-modal data assistance without considering multi-modal calibration or the impact of inference latency of different sub-modules. Thus, in this study, we design a decision-level multi-modal (mmWave received signal power vector, RGB image and GPS data) fusion for sensing-aided beam tracking (DMBT) method. The proposed DMBT method includes three designed mechanisms, namely normal prediction process, beam misalignment alert and beam tracking correction. The normal prediction process conducts partial beam training instead of exhaustive beam training, which largely reduces large beam training overhead. It also comprehensively selects prediction results from multi-modal data to enhance the DMBT method robustness to noise. The beam misalignment alert based on RGB image and GPS data detects whether there exists beam misalignment and also predict the optimal beam. The beam tracking correction is designed to capture the optimal beam if misalignment happens by reusing certain blocks in normal prediction process and possibly outdated prediction results. Finally, we evaluate the proposed DMBT method in the vehicle-to-infrastructure scenario based on a real-world dataset. The results show that the method is capable of self-correction and mitigating the negative effect of the relative inference latency. Moreover, 75%–93% beam training overhead can be saved to maintain reliable communication even when faced with considerable noise in measurement data.

Research and Verification of Sensing Information Assisted Millimeter Wave Beam Tracking Algorithm for Automated Vehicles

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

Airborne Laser Communication System with Automated Tracking

Hardware Verification and Performance Evaluation of MmWave Beam Tracking for Integrated Sensing and Communication

Camera-Sensing-Assisted Fast Mmwave Beam Tracking for Connected Automated Vehicles

Testbed and Performance Evaluation of 3D MmWave Beam Tracking in Mobility Scenario

3-D LiDAR and GPS Aided Beam Tracking in Millimeter Wave Vehicular Communications

Predictive Beam Tracking with Cooperative Sensing for Vehicle-to-Infrastructure Communications.

Mobility-aware Adaptive Beam Tracking for Vehicles in MmWave Communication Networks

Fast Channel Estimation and Beam Tracking for Millimeter Wave Vehicular Communications

Millimeter Wave V2V Beam Tracking using Radar: Algorithms and Real-World Demonstration

Vehicle Behavior-Cognition-Based Particle-Filter-Enabled mmWave Beam Tracking for Connected Automated Vehicles

Data-Driven Multi-armed Beam Tracking for Mobile Millimeter-Wave Communication Systems

Machine Learning Based Mmwave Channel Tracking in Vehicular Scenario

Robust Adaptive Beam Tracking for Mobile Millimetre Wave Communications

Integrated Sensing and Communication-Enabled Predictive Beamforming with Deep Learning in Vehicular Networks

Integrated Sensing and Communication-Promoted Beam Tracking and Coverage for Complex Vehicular Networks

Radar-Assisted Multiple Base Station Cooperative mmWave Beam Tracking

Energy-Angle Domain Initial Access and Beam Tracking in Millimeter Wave V2X Communications.

Multi-modal fusion for sensing-aided beam tracking in mmWave communications

Successive Pose Estimation and Beam Tracking for mmWave Vehicular Communication Systems