Abstract:Millimeter-wave (mmWave) hybrid analog-digital beamforming is a promising approach to satisfy the low-latency constraint in multiple unmanned aerial vehicles (UAVs) systems, which serve as network infrastructure for flexible deployment. However, in highly dynamic multi-UAV environments, analog beam tracking becomes a critical challenge. The overhead of additional pilot transmission at the price of spectral efficiency is shown necessary to achieve high resilience in operation. An efficient method to deal with high dynamics of UAVs applies machine learning, particularly Q-learning, to analog beam tracking. The proposed Q-learning-based beam tracking scheme uses current/past observations to design rewards from environments to facilitate prediction, which significantly increases the efficiency of data transmission and beam switching. Given the selected analog beams, the goal of digital beamforming is to maximize the SINR. The received pilot signals are utilized to approximate the desired signal and interference power, which yield the SINR measurements as well as the optimal digital weights. Since the selected analog beams based on the received power do not guarantee the hybrid beamforming achieving the maximization SINR, we therefore reserve additional analog beams as candidates during the beam tracking. The combination of analog beams with their digital weights achieving the maximum SINR consequently provides the optimal solution to the hybrid beamforming.

Deep Learning-Based Beam Alignment and Tracking Mechanism for Mmwave Aerial Base Station

Beam prediction and tracking mechanism with enhanced LSTM for mmWave aerial base station

Enhancing Mmwave Beam Prediction Through Deep Learning with Sub-6 GHz Channel Estimate

Deep Learning Based Adaptive Joint mmWave Beam Alignment

Deep Learning for Hierarchical Beam Alignment in mmWave Communication Systems

Deep Learning Assisted Adaptive mmWave Beam Tracking: A Sum-Probability Oriented Methodology

Hierarchical Beam Alignment for Millimeter-Wave Communication Systems: A Deep Learning Approach

Deep Learning Based Joint Beam Selection and Precoding Design for Mmwave Systems with Lens Arrays

Machine-Learning Beam Tracking and Weight Optimization for mmWave Multi-UAV Links

Millimeter-Wave Networking in the Sky: A Machine Learning and Mean Field Game Approach for Joint Beamforming and Beam-Steering

Dynamic Beam Tracking for Mobile Users

Deep Learning Assisted Mmwave Beam Prediction with Prior Low-frequency Information

Deep Learning for Mmwave Beam-Management: State-of-the-Art, Opportunities and Challenges

Third-party Camera Aided Beam Alignment Real-world Prototype for Mmwave Communications

Deep learning-based beam alignment in mmWave vehicular networks

Deep Learning Assisted mmWave Beam Prediction for Heterogeneous Networks: A Dual-Band Fusion Approach

Deep Learning for Beam-Management: State-of-the-Art, Opportunities and Challenges

Deep Learning Aided Two-Stage Multi-Finger Beam Training in Millimeter-Wave Communication

UAV Beam Alignment for Highly Mobile Millimeter Wave Communications

Intelligent Beam Tracking in Radar-assisted MIMO-OFDM Communication Systems

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks