Abstract:Millimeter wave (mmWave) communication has attracted extensive attention and research due to its wide bandwidth and abundant spectrum resources. Effective and fast beam tracking is a critical challenge for the practical deployment of mmWave communications. Existing studies demonstrate the potential of sensing-aided beam tracking. However, most studies are focus on single-modal data assistance without considering multi-modal calibration or the impact of inference latency of different sub-modules. Thus, in this study, we design a decision-level multi-modal (mmWave received signal power vector, RGB image and GPS data) fusion for sensing-aided beam tracking (DMBT) method. The proposed DMBT method includes three designed mechanisms, namely normal prediction process, beam misalignment alert and beam tracking correction. The normal prediction process conducts partial beam training instead of exhaustive beam training, which largely reduces large beam training overhead. It also comprehensively selects prediction results from multi-modal data to enhance the DMBT method robustness to noise. The beam misalignment alert based on RGB image and GPS data detects whether there exists beam misalignment and also predict the optimal beam. The beam tracking correction is designed to capture the optimal beam if misalignment happens by reusing certain blocks in normal prediction process and possibly outdated prediction results. Finally, we evaluate the proposed DMBT method in the vehicle-to-infrastructure scenario based on a real-world dataset. The results show that the method is capable of self-correction and mitigating the negative effect of the relative inference latency. Moreover, 75%–93% beam training overhead can be saved to maintain reliable communication even when faced with considerable noise in measurement data.

Third-party Camera Aided Beam Alignment Real-world Prototype for Mmwave Communications

An RFSoC Prototype for Third-party Camera Aided Mmwave Communications

Joint Task Allocation and Hybrid Beamforming for mmWave D2D MEC Systems

Intelligent Angle Map-based Beam Alignment for RIS-aided mmWave Communication Networks

A Deep Learning Approach to Location- and Orientation-aided 3D Beam Selection for mmWave Communications

Incremental Collaborative Beam Alignment for Millimeter Wave Cell-Free MIMO Systems

3D Scene Based Beam Selection for Mmwave Communications

Compressed Beam Alignment with Out-of-Band Assistance in Millimeter Wave Cellular Networks

Vision-aided Multi-user Beam Tracking for Mmwave Massive MIMO System: Prototyping and Experimental Results

Hierarchical Beam Alignment for Millimeter-Wave Communication Systems: A Deep Learning Approach

Position-Aware Beam Training for Near-Field Milimeter-Wave XL-MIMO Communications

Multi-Camera Views Based Beam Searching and BS Selection with Reduced Training Overhead

Data-Driven Multi-armed Beam Tracking for Mobile Millimeter-Wave Communication Systems

Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios

Beam Alignment in MmWave V2X Communications: A Survey

mmRAPID: Machine Learning assisted Noncoherent Compressive Millimeter-Wave Beam Alignment

Multi-modal fusion for sensing-aided beam tracking in mmWave communications

Beam Alignment and Tracking for Millimeter Wave Communications via Bandit Learning

Continuous Beam Alignment for Mobile MIMO

Deep Learning Based Adaptive Joint mmWave Beam Alignment