Abstract:Recently, with the development of autonomous driving technology, vehicle-to-everything (V2X) communication technology that provides a wireless connection between vehicles, pedestrians, and roadside base stations has gained significant attention. Vehicle-to-vehicle (V2V) communication should provide low-latency and highly reliable services through direct communication between vehicles, improving safety. In particular, as the number of vehicles increases, efficient radio resource management becomes more important. In this paper, we propose a deep reinforcement learning (DRL)-based decentralized resource allocation scheme in the V2X communication network in which the radio resources are shared between the V2V and vehicle-to-infrastructure (V2I) networks. Here, a deep Q-network (DQN) is utilized to find the resource blocks and transmit power of vehicles in the V2V network to maximize the sum rate of the V2I and V2V links while reducing the power consumption and latency of V2V links. The DQN also uses the channel state information, the signal-to-interference-plus-noise ratio (SINR) of V2I and V2V links, and the latency constraints of vehicles to find the optimal resource allocation scheme. The proposed DQN-based resource allocation scheme ensures energy-efficient transmissions that satisfy the latency constraints for V2V links while reducing the interference of the V2V network to the V2I network. We evaluate the performance of the proposed scheme in terms of the sum rate of the V2X network, the average power consumption of V2V links, and the average outage probability of V2V links using a case study in Manhattan with nine blocks of 3GPP TR 36.885. The simulation results show that the proposed scheme greatly reduces the transmit power of V2V links when compared to the conventional reinforcement learning-based resource allocation scheme without sacrificing the sum rate of the V2X network or the outage probability of V2V links.

When DSRC Meets with C-V2X: How to Jointly Predict and Select Idle Channels?

Semi-Persistent Resource Allocation Based on Traffic Prediction for Vehicular Communications

Dynamic Spectrum Access for C-V2X via Imitating Indian Buffet Process

Channel Estimation Based on Deep Learning in Vehicle-to-Everything Environments

Energy-Efficient Resource Allocation Based on Deep Q-Network in V2V Communications

Deep Reinforcement Learning Based Mode Selection and Resource Allocation for Cellular V2X Communications

Joint mode selection and resource allocation for cellular V2X communication using distributed deep reinforcement learning under 5G and beyond networks

Radio Resource Management for C-V2X: From a Hybrid Centralized-Distributed Scheme to a Distributed Scheme

Spectrum-Energy-Efficient Mode Selection and Resource Allocation for Heterogeneous V2X Networks: A Federated Multi-Agent Deep Reinforcement Learning Approach

Reuse Distance-Aided Resource Selection Mechanisms for NR-V2X Sidelink Communication

Deep Reinforcement Learning-Based Dynamic Spectrum Access for D2D Communication Underlay Cellular Networks

A deep reinforcement learning-based D2D spectrum allocation underlaying a cellular network

Joint Optimization of Spectrum and Energy Efficiency Considering the C-V2X Security: A Deep Reinforcement Learning Approach

Enhanced C-V2X Mode-4 Subchannel Selection

Multi-Agent RL Enables Decentralized Spectrum Access in Vehicular Networks

Joint Channel Selection using FedDRL in V2X

DSRC and LTE-V Communication Performance Evaluation and Improvement Based on Typical V2X Application at Intersection

Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks

Heterogeneous LTE/DSRC Approach to Support Real-time Vehicular Communications

An Intelligent Congestion Control Strategy in Heterogeneous V2X Based on Deep Reinforcement Learning

V2X and Deep Reinforcement Learning-Aided Mobility-Aware Lane Changing for Emergency Vehicle Preemption in Connected Autonomous Transport Systems