Abstract:Recently, with the development of autonomous driving technology, vehicle-to-everything (V2X) communication technology that provides a wireless connection between vehicles, pedestrians, and roadside base stations has gained significant attention. Vehicle-to-vehicle (V2V) communication should provide low-latency and highly reliable services through direct communication between vehicles, improving safety. In particular, as the number of vehicles increases, efficient radio resource management becomes more important. In this paper, we propose a deep reinforcement learning (DRL)-based decentralized resource allocation scheme in the V2X communication network in which the radio resources are shared between the V2V and vehicle-to-infrastructure (V2I) networks. Here, a deep Q-network (DQN) is utilized to find the resource blocks and transmit power of vehicles in the V2V network to maximize the sum rate of the V2I and V2V links while reducing the power consumption and latency of V2V links. The DQN also uses the channel state information, the signal-to-interference-plus-noise ratio (SINR) of V2I and V2V links, and the latency constraints of vehicles to find the optimal resource allocation scheme. The proposed DQN-based resource allocation scheme ensures energy-efficient transmissions that satisfy the latency constraints for V2V links while reducing the interference of the V2V network to the V2I network. We evaluate the performance of the proposed scheme in terms of the sum rate of the V2X network, the average power consumption of V2V links, and the average outage probability of V2V links using a case study in Manhattan with nine blocks of 3GPP TR 36.885. The simulation results show that the proposed scheme greatly reduces the transmit power of V2V links when compared to the conventional reinforcement learning-based resource allocation scheme without sacrificing the sum rate of the V2X network or the outage probability of V2V links.

Deep Reinforcement Learning for Energy Saving in Radio Access Network

Collaborative Multi-BS Power Management for Dense Radio Access Network using Deep Reinforcement Learning

Deep Reinforcement Learning With Spatio-Temporal Traffic Forecasting for Data-Driven Base Station Sleep Control

DeepNap: Data-Driven Base Station Sleeping Operations Through Deep Reinforcement Learning

Energy Saving Through a Learning Framework in Greener Cellular Radio Access Networks.

Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

Design and Evaluation of Deep Reinforcement Learning for Energy Saving in Open RAN

Deep Reinforcement Learning for Network Energy Saving in 6G and Beyond Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Deep Reinforcement Learning for Energy-Efficient Power Control in Heterogeneous Networks

Static Deep Q-learning for Green Downlink C-RAN

Deep Reinforcement Learning Based Mode Selection and Power Allocation Scheme for Convergent Power-Efficient Network.

Using Reinforcement Learning to Reduce Energy Consumption of Ultra-Dense Networks With 5G Use Cases Requirements

Deep reinforcement learning for RAN optimization and control

Deep Reinforcement Learning Method for Energy Efficient Resource Allocation in Next Generation Wireless Networks.

Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks.

TACT: A Transfer Actor-Critic Learning Framework for Energy Saving in Cellular Radio Access Networks.

Energy Saving in 6G O-RAN Using DQN-based xApp

A Reinforcement Learning Framework for Autonomous Cell Activation and Customized Energy-Efficient Resource Allocation in C-RANs.

Deep Reinforcement Learning-Based Energy Consumption Optimization for Peer-to-Peer (P2P) Communication in Wireless Sensor Networks

Energy-Efficient Resource Allocation Based on Deep Q-Network in V2V Communications