Abstract:Recently, with the development of autonomous driving technology, vehicle-to-everything (V2X) communication technology that provides a wireless connection between vehicles, pedestrians, and roadside base stations has gained significant attention. Vehicle-to-vehicle (V2V) communication should provide low-latency and highly reliable services through direct communication between vehicles, improving safety. In particular, as the number of vehicles increases, efficient radio resource management becomes more important. In this paper, we propose a deep reinforcement learning (DRL)-based decentralized resource allocation scheme in the V2X communication network in which the radio resources are shared between the V2V and vehicle-to-infrastructure (V2I) networks. Here, a deep Q-network (DQN) is utilized to find the resource blocks and transmit power of vehicles in the V2V network to maximize the sum rate of the V2I and V2V links while reducing the power consumption and latency of V2V links. The DQN also uses the channel state information, the signal-to-interference-plus-noise ratio (SINR) of V2I and V2V links, and the latency constraints of vehicles to find the optimal resource allocation scheme. The proposed DQN-based resource allocation scheme ensures energy-efficient transmissions that satisfy the latency constraints for V2V links while reducing the interference of the V2V network to the V2I network. We evaluate the performance of the proposed scheme in terms of the sum rate of the V2X network, the average power consumption of V2V links, and the average outage probability of V2V links using a case study in Manhattan with nine blocks of 3GPP TR 36.885. The simulation results show that the proposed scheme greatly reduces the transmit power of V2V links when compared to the conventional reinforcement learning-based resource allocation scheme without sacrificing the sum rate of the V2X network or the outage probability of V2V links.

RLFN-VRA: Reinforcement Learning-based Flexible Numerology V2V Resource Allocation for 5G NR V2X Networks

Two-Timescale Resource Management for Ultrareliable and Low-Latency Vehicular Communications

Resource Allocation for Vehicle Platooning in 5G NR-V2X via Deep Reinforcement Learning

Joint Optimization of Age of Information and Energy Consumption in NR-V2X System based on Deep Reinforcement Learning

Event-Triggered Reinforcement Learning Based Joint Resource Allocation for Ultra-Reliable Low-Latency V2X Communications

Beam management optimization for V2V communications based on deep reinforcement learning

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Evaluating the Impact of Numerology and Retransmission on 5G NR V2X Communication at A System-Level Simulation

A Lightweight QoS-Aware Resource Allocation Method for NR-V2X Networks

Energy-Efficient Resource Allocation Based on Deep Q-Network in V2V Communications

Deep Reinforcement Learning Assisted Hybrid Precoding for V2I Communications with Doppler Shift and Delay Spread

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Fuzzy Logic-Based Resource Allocation Algorithm for V2X Communications in 5G Cellular Networks

Deep Reinforcement Learning Based Mode Selection and Resource Allocation for Cellular V2X Communications

Deep Reinforcement Learning-Based Resource Allocation for Cellular Vehicular Network Mode 3 with Underlay Approach

Machine Learning Enables Radio Resource Allocation in the Downlink of Ultra-Low Latency Vehicular Networks

Joint mode selection and resource allocation for cellular V2X communication using distributed deep reinforcement learning under 5G and beyond networks

Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks with Emergent Communication

Learn to Allocate Resources in Vehicular Networks

Semantic-Aware Resource Allocation Based on Deep Reinforcement Learning for 5G-V2X HetNets