Abstract:Millimeter wave (mmWave) communication has attracted extensive attention and research due to its wide bandwidth and abundant spectrum resources. Effective and fast beam tracking is a critical challenge for the practical deployment of mmWave communications. Existing studies demonstrate the potential of sensing-aided beam tracking. However, most studies are focus on single-modal data assistance without considering multi-modal calibration or the impact of inference latency of different sub-modules. Thus, in this study, we design a decision-level multi-modal (mmWave received signal power vector, RGB image and GPS data) fusion for sensing-aided beam tracking (DMBT) method. The proposed DMBT method includes three designed mechanisms, namely normal prediction process, beam misalignment alert and beam tracking correction. The normal prediction process conducts partial beam training instead of exhaustive beam training, which largely reduces large beam training overhead. It also comprehensively selects prediction results from multi-modal data to enhance the DMBT method robustness to noise. The beam misalignment alert based on RGB image and GPS data detects whether there exists beam misalignment and also predict the optimal beam. The beam tracking correction is designed to capture the optimal beam if misalignment happens by reusing certain blocks in normal prediction process and possibly outdated prediction results. Finally, we evaluate the proposed DMBT method in the vehicle-to-infrastructure scenario based on a real-world dataset. The results show that the method is capable of self-correction and mitigating the negative effect of the relative inference latency. Moreover, 75%–93% beam training overhead can be saved to maintain reliable communication even when faced with considerable noise in measurement data.

Multi-modal fusion for sensing-aided beam tracking in mmWave communications

Angular-Domain Selective Channel Tracking and Doppler Compensation for High-Mobility Mmwave Massive MIMO

Advancing Multi-Modal Beam Prediction with Multipath-Like Data Augmentation and Efficient Fusion Mechanism

3-D LiDAR and GPS Aided Beam Tracking in Millimeter Wave Vehicular Communications

Multimodal Fusion Assisted mmWave Beam Training in Dual-Model Networks

Data-Driven Multi-armed Beam Tracking for Mobile Millimeter-Wave Communication Systems

Vision-aided Multi-user Beam Tracking for Mmwave Massive MIMO System: Prototyping and Experimental Results

Millimetre-Wave Beam Tracking: an Intelligent Machine Learning and Kalman Filter Fusion Technology

Position Prediction Based Fast Beam Tracking Scheme for Multi-User UAV-mmWave Communications.

Mobility-aware Adaptive Beam Tracking for Vehicles in MmWave Communication Networks

FC-BET: A Fast Consecutive Beam Tracking Scheme for MmWave Vehicular Communications

Intelligent Beam Tracking in Radar-assisted MIMO-OFDM Communication Systems

Integrated Sensing and Communications Towards Proactive Beamforming in mmWave V2I via Multi-Modal Feature Fusion (MMFF)

Multi-modal Fusion for Millimeter-Wave Communication Systems: A Spatio-Temporal Enabled Approach

Hardware Verification and Performance Evaluation of MmWave Beam Tracking for Integrated Sensing and Communication

Multi-Source Low Redundancy Data-Aided Beam Prediction for V2I Communication

Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios

Joint Multi-Beam and Channel Tracking for Mmwave Hybrid Beamforming Multi-User Systems.

Robust Adaptive Beam Tracking for Mobile Millimetre Wave Communications

Multimodal Deep Learning Empowered Millimeter-Wave Beam Prediction

Fast Beam Training Architecture for Hybrid Mmwave Transceivers