Abstract:Resource management in the next-generation vehicle-to-everything (V2X) communication networks is a demanding research problem. It is difficult to achieve the best results if the resources are not managed efficiently. To address this challenge and facilitate the dynamic movement of network demands, efficient management of resources is crucial. In this context, we propose a duplex deep reinforcement learning (DDRL)-based resource management framework for next-generation V2X communication networks. Our framework considers multiple network state parameters and utilizes these resources during the learning phase to address resource management problems effectively. The key objective was to select the forthcoming resource control state through the duplex deep reinforcement learning phase, thereby optimizing resource utilization efficiency. To achieve this, we jointly implement time division duplexing (TDD) and frequency division duplexing (FDD), which allow for adaptive management of TDD and FDD to meet high mobility requirements and efficiently utilize limited radio resources. This study introduces a dynamic duplex deep Q-learning-assisted sequential decision-making algorithm to manage band resources for the next-generation V2X network. By employing this algorithm, we enable the efficient allocation of resources, considering factors such as latency, system throughput, network utilization, busy channel rate (BCR), and packet received rate. To validate the performance of our proposed framework, we conducted simulation experiments using benchmarking techniques. The results demonstrate that our framework outperforms benchmark approaches across various performance parameters. It exhibits superior efficiency in terms of latency, system throughput, network utilization, BCR, and packet received rate.

Dual-layer Deep Reinforcement Learning for Joint Beam Management and Resource Allocation

Beam management optimization for V2V communications based on deep reinforcement learning

Deep Reinforcement Learning Based Wireless Resource Allocation for V2X Communications

Deep Reinforcement Learning-Based Multi-Panel Beam Management in Massive MIMO Systems: Algorithm Design and System-Level Simulation

Joint Relay Selection and Beam Management Based on Deep Reinforcement Learning for Millimeter Wave Vehicular Communication

Learning-assisted User Scheduling and Beamforming for mmWave Vehicular Networks

Integrated Beamforming and Resource Allocation in RIS-Assisted Mmwave Networks Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Dynamic Beam Selection in Dual-Band Communication Systems

Deep Reinforcement Learning Based Mode Selection and Resource Allocation for Cellular V2X Communications

DRL-based Beam Allocation in Relay-aided Multi-user MmWave Vehicular Networks

Deep Reinforcement Learning-Based Resource Management in Maritime Communication Systems

Attention-deep reinforcement learning jointly beamforming based on tensor decomposition for RIS-assisted V2X mmWave massive MIMO system

Distributed Beam Selection for Millimeter-Wave Cell-Free Massive MIMO Based on Multi-Agent Deep Reinforcement Learning

Joint Beamforming in RIS-Assisted Multi-User Transmission Design: A Model-Driven Deep Reinforcement Learning Framework

Federated Multi-Agent Deep Reinforcement Learning for Resource Allocation of Vehicle-to-Vehicle Communications

Multi-agent Reinforcement Learning Based Resource Allocation for Vehicular Networks.

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

A Novel Duplex Deep Reinforcement Learning Based RRM Framework for Next-Generation V2X Communication Networks.

Deep Reinforcement Learning for Distributed Dynamic MISO Downlink-Beamforming Coordination

Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks

Event-Triggered Reinforcement Learning Based Joint Resource Allocation for Ultra-Reliable Low-Latency V2X Communications