Abstract:In millimeter wave (mmWave) vehicular communications, multi-hop relay disconnection by line-of-sight (LOS) blockage is a critical problem, particularly in the early diffusion phase of mmWave-available vehicles, where not all vehicles have mmWave communication devices. This paper proposes a distributed position control method to establish long relay paths through road side units (RSUs). This is realized by a scheme via which autonomous vehicles change their relative positions to communicate with each other via LOS paths. Even though vehicles with the proposed method do not use all the information of the environment and do not cooperate with each other, they can decide their action (e.g., lane change and overtaking) and form long relays only using information of their surroundings (e.g., surrounding vehicle positions). The decision-making problem is formulated as a Markov decision process such that autonomous vehicles can learn a practical movement strategy for making long relays by a reinforcement learning (RL) algorithm. This paper designs a learning algorithm based on a sophisticated deep reinforcement learning algorithm, asynchronous advantage actor-critic (A3C), which enables vehicles to learn a complex movement strategy quickly through its deep-neural-network architecture and multi-agent-learning mechanism. Once the strategy is well trained, vehicles can move independently to establish long relays and connect to the RSUs via the relays. Simulation results confirm that the proposed method can increase the relay length and coverage even if the traffic conditions and penetration ratio of mmWave communication devices in the learning and operation phases are different.

Assessing Hazardous Waste Transport Risks Using a GIS

Extending 5G NR V2X Mode 2 to Enable Integrated Sensing and Communication for Vehicular Networks

3D Modeling and Analysis of Cooperative Perception-Oriented Millimeter-Wave V2I Networks With Information Value-Based Relay

VANET-Assisted Interference Mitigation for Millimeter-Wave Automotive Radar Sensors.

Millimeter Wave V2V Communications: Distributed Association and Beam Alignment

Efficient V2V Communication Scheme for 5G MmWave Hyper-Connected CAVs

On the Feasibility of Integrating mmWave and IEEE 802.11p for V2V Communications

Two-Timescale Resource Management for Ultrareliable and Low-Latency Vehicular Communications

Interference and Coverage Analysis of mmWave Inter-Vehicle Broadcast with Directional Antennas

Towards mmWave V2X in 5G and Beyond to Support Automated Driving

QoS-aware Interference Management for Vehicular D2D Relay Networks

Taming Distributed One-Hop Multicasting in Millimeter-Wave VANETs

Towards Safe Automated Driving: Design of Software-Defined Dynamic MmWave V2X Networks and PoC Implementation

Analysis of Intelligent Vehicular Relaying in Urban 5G+ Millimeter-Wave Cellular Deployments

Joint Optimization of Relay Selection and Transmission Scheduling for UAV-Aided mmWave Vehicular Networks

Intelligent Vehicle Network Routing With Adaptive 3D Beam Alignment for mmWave 5G-Based V2X Communications

Joint Optimization of Relay Selection and Transmission Scheduling for UAV-Aided mm Wave Vehicular Networks

Deep-Reinforcement-Learning-Based Distributed Vehicle Position Controls for Coverage Expansion in mmWave V2X

mmWave Enabled Connected Autonomous Vehicles: A Use Case with V2V Cooperative Perception

Vehicular Blockage Modelling and Performance Analysis for mmWave V2V Communications