Abstract:Intelligent connected vehicles have garnered significant attention from both academia and industry in recent years as they form the backbone of intelligent transportation and smart cities. Vehicular networks now exchange a range of mixed information types, including safety, sensing, and multimedia, due to advancements in communication and vehicle technology. Accordingly, performance requirements have also evolved, prioritizing higher spectral efficiencies while maintaining low latency and high communication reliability. To address the trade-off between communication spectral efficiency, delay, and reliability, the 3rd Generation Partnership Project (3GPP) recommends the 5G NR FR2 frequency band (24 GHz to 71 GHz) for vehicle-to-everything communications (V2X) in the Release 17 standard. However, wireless transmissions at such high frequencies pose challenges such as high path loss, signal processing complexity, long pre-access phase, unstable network structure, and fluctuating channel conditions. To overcome these issues, this paper proposes a deep reinforcement learning (DRL)-assisted intelligent beam management method for vehicle-to-vehicle (V2V) communication. By utilizing DRL, the optimal control of beam management (i.e., beam alignment and tracking) is achieved, enabling a trade-off among spectral efficiency, delay, and reliability in complex and fluctuating communication scenarios at the 5G NR FR2 band. Simulation results demonstrate the superiority of our method over the 5G standard-based beam management method in communication delay, and the extended Kalman Filter (EKF)-based beam management method in reliability and spectral efficiency.

Intelligent Beam Management Based on Deep Reinforcement Learning in High-Speed Railway Scenarios

Deep Reinforcement Learning Coordinated Receiver Beamforming for Millimeter-Wave Train-ground Communications

When mmWave High-Speed Railway Networks Meet Reconfigurable Intelligent Surface: A Deep Reinforcement Learning Method

Efficient Initial Access with Deep Reinforcement Learning Based Beam Sweeping in Wireless Cellular Communication Systems

Learning-Aided Beam Prediction in mmWave MU-MIMO Systems for High-Speed Railway

Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems

Efficient Hybrid Beamforming with Anti-Blockage Design for High-Speed Railway Communications

Empirical Study on Directional Millimeter-Wave Propagation in Railway Communications Between Train and Trackside

Two-Stage Beamforming Design for High-Speed Train Mmwave Communications

Learning-assisted User Scheduling and Beamforming for mmWave Vehicular Networks

On Hybrid Beamforming of mmWave MU-MIMO System for High-Speed Railways

Intelligent Beam Training for Millimeter-Wave Communications Via Deep Reinforcement Learning

Beam Management in Ultra-Dense mmWave Network via Federated Reinforcement Learning: An Intelligent and Secure Approach

Beam management optimization for V2V communications based on deep reinforcement learning

Beam Switching Based Beam Design for High-Speed Train mmWave Communications

Joint Design of Phase Shift and Transceiver Beamforming for Intelligent Reflecting Surface Assisted Millimeter-Wave High-Speed Railway Communications

Deep Reinforcement Learning for Beam Management in UAV Relay mmWave Networks

Intelligent Interactive Beam Training for Millimeter Wave Communications

Hybrid Beamforming for Mmwave MU-MISO Systems Exploiting Multi-Agent Deep Reinforcement Learning

Intelligent flying-beamformer for hybrid mmWave systems: A deep reinforcement learning approach

DRL-based Beam Allocation in Relay-aided Multi-user MmWave Vehicular Networks