Abstract:To address communication latency issues, the Third Generation Partnership Project (3GPP) has defined Cellular-Vehicle to Everything (C-V2X) technology, which includes Vehicle-to-Vehicle (V2V) communication for direct vehicle-to-vehicle communication. However, this method requires vehicles to autonomously select communication resources based on the Semi-Persistent Scheduling (SPS) protocol, which may lead to collisions due to different vehicles sharing the same communication resources, thereby affecting communication effectiveness. Non-Orthogonal Multiple Access (NOMA) is considered a potential solution for handling large-scale vehicle communication, as it can enhance the Signal-to-Interference-plus-Noise Ratio (SINR) by employing Successive Interference Cancellation (SIC), thereby reducing the negative impact of communication collisions. When evaluating vehicle communication performance, traditional metrics such as reliability and transmission delay present certain contradictions. Introducing the new metric Age of Information (AoI) provides a more comprehensive evaluation of communication system. Additionally, to ensure service quality, user terminals need to possess high computational capabilities, which may lead to increased energy consumption, necessitating a trade-off between communication energy consumption and effectiveness. Given the complexity and dynamics of communication systems, Deep Reinforcement Learning (DRL) serves as an intelligent learning method capable of learning optimal strategies in dynamic environments. Therefore, this paper analyzes the effects of multi-priority queues and NOMA on AoI in the C-V2X vehicular communication system and proposes an energy consumption and AoI optimization method based on DRL. Finally, through comparative simulations with baseline methods, the proposed approach demonstrates its advances in terms of energy consumption and AoI.

Power Control of 5G-Connected Vehicular Network Using PPO-Based Deep Reinforcement Learning Algorithm

Using Deep Reinforcement Learning for 5G RAN Slicing Resource Allocation in New Power Load Management System

Adaptive Sidelink Open Loop Power Control Optimization Strategies for Vehicle-to- Vehicle Communications in 5G-NR-V2X

PPO-based Energy-efficient Power Control and Spectrum Allocation in In-Vehicle HetNets

DDPG with Transfer Learning and Meta Learning Framework for Resource Allocation in Underlay Cognitive Radio Network

Reinforcement Learning for Energy Optimization with 5G Communications in Vehicular Social Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Authentication and Resource Allocation Strategies during Handoff for 5G IoVs Using Deep Learning

Decentralized Power Allocation for MIMO-NOMA Vehicular Edge Computing Based on Deep Reinforcement Learning

Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches

Resource Allocation for Vehicle Platooning in 5G NR-V2X via Deep Reinforcement Learning

Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Semantic-Aware Resource Allocation Based on Deep Reinforcement Learning for 5G-V2X HetNets

A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL

Decentralized Deep Reinforcement Learning for Delay-Power Tradeoff in Vehicular Communications

Federated Deep Reinforcement Learning Based Task Offloading with Power Control in Vehicular Edge Computing

Downlink Power Control for Cell-Free Massive MIMO with Deep Reinforcement Learning

DRL-Based Optimization for AoI and Energy Consumption in C-V2X Enabled IoV

Dynamics of Resource Allocation in O-RANs: An In-depth Exploration of On-Policy and Off-Policy Deep Reinforcement Learning for Real-Time Applications

Channel assignment and power allocation for throughput improvement with PPO in B5G heterogeneous edge networks

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications