Abstract:Autonomous driving may be the most important application scenario of next generation, the development of wireless access technologies enabling reliable and low-latency vehicle communication becomes crucial. To address this, 3GPP has developed Vehicle-to-Everything (V2X) specifications based on 5G New Radio (NR) technology, where Mode 2 Side-Link (SL) communication resembles Mode 4 in LTE-V2X, allowing direct communication between vehicles. This supplements SL communication in LTE-V2X and represents the latest advancement in cellular V2X (C-V2X) with improved performance of NR-V2X. However, in NR-V2X Mode 2, resource collisions still occur, and thus degrade the age of information (AOI). Therefore, a interference cancellation method is employed to mitigate this impact by combining NR-V2X with Non-Orthogonal multiple access (NOMA) technology. In NR-V2X, when vehicles select smaller resource reservation interval (RRI), higher-frequency transmissions take ore energy to reduce AoI. Hence, it is important to jointly consider AoI and communication energy consumption based on NR-V2X communication. Then, we formulate such an optimization problem and employ the Deep Reinforcement Learning (DRL) algorithm to compute the optimal transmission RRI and transmission power for each transmitting vehicle to reduce the energy consumption of each transmitting vehicle and the AoI of each receiving vehicle. Extensive simulations have demonstrated the performance of our proposed algorithm.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to jointly optimize the freshness of information (Age of Information, AoI) and energy consumption in the Internet of Vehicles based on the 5G NR - V2X (New Radio Vehicle - to - Everything) system. Specifically: 1. **Resource Collision Problem**: In NR - V2X mode 2, due to the existence of the autonomous resource allocation method, resource collisions may occur between vehicles, thereby degrading the performance of AoI. 2. **Trade - off between Energy Consumption and AoI**: When a vehicle selects a smaller resource reservation interval (RRI), although it can transmit more frequently to reduce AoI, this will increase energy consumption. Therefore, a balance point needs to be found between AoI and energy consumption. To solve these problems, the authors propose the following methods: - **Introducing Non - Orthogonal Multiple Access (NOMA) Technology**: Use NOMA technology to alleviate the impact of resource collisions on AoI. NOMA allows multiple users to communicate simultaneously in the same frequency band, thereby reducing interference and improving SINR (Signal - to - Interference - plus - Noise Ratio). - **Optimization Algorithm Based on Deep Reinforcement Learning (DRL)**: Construct an optimization problem and use a deep reinforcement learning algorithm to calculate the optimal RRI and transmission power for each transmitting vehicle, in order to reduce the energy consumption of each transmitting vehicle and the AoI of the receiving vehicle. Finally, the effectiveness of the proposed algorithm is verified through extensive simulations, proving that this method can reduce energy consumption during the communication process while ensuring a low AoI. ### Summary of Mathematical Formulas - **SINR Expression**: \[ \eta_{i \rightarrow j}^t=\frac{h_t^s h_{i \rightarrow j}^t p_i^t}{L_d(d_{i \rightarrow j}) I_{i \rightarrow j}^t + p_n} \] where: - \(h_t^s\) is the random small - scale fading gain. - \(h_{i \rightarrow j}^t\) is the large - scale fading gain. - \(p_i^t\) is the transmission power of vehicle \(i\). - \(L_d(d_{i \rightarrow j})\) is the path loss. - \(I_{i \rightarrow j}^t\) is the interference power. - \(p_n\) is the noise power. - **Interference Power Expression**: \[ I_{i \rightarrow j}^t=\sum_{k \in V_t, k \neq i} \sigma_{k,i}^t h_t^s h_{k \rightarrow j}^t \frac{p_k^t}{L_d(d_{k \rightarrow j})} \] - **Successful Communication Condition**: \[ u_{i \rightarrow j}^t=\left\lfloor\frac{W_t^i \log_2(1 + \eta_{i \rightarrow j}^t)}{G}\right\rfloor \] - **AoI Change**: \[ \Phi_{i \rightarrow j}^{t+\Gamma}= \begin{cases} \phi_{t,1}^n+\Gamma & \text{if } u_{i \rightarrow j}^t = 1\\ \Phi_{i \rightarrow j}^t+\Gamma & \text{if } u_{i \rightarrow j}^t = 0 \end{cases} \] - **Optimization Objective**: \[ \min_{\Gamma_t, p_t}\left[\omega_1 E+\omega_2 \Phi\right]

Joint Optimization of Age of Information and Energy Consumption in NR-V2X System based on Deep Reinforcement Learning

DRL-Based Optimization for AoI and Energy Consumption in C-V2X Enabled IoV

Energy-Efficient Resource Allocation Based on Deep Q-Network in V2V Communications

Age of Information-Aware Radio Resource Management in Vehicular Networks: A Proactive Deep Reinforcement Learning Perspective

Deep Reinforcement Learning Based Mode Selection and Resource Allocation for Cellular V2X Communications

Non-orthogonal Age-Optimal Information Dissemination in Vehicular Networks: A Meta Multi-Objective Reinforcement Learning Approach

Joint mode selection and resource allocation for cellular V2X communication using distributed deep reinforcement learning under 5G and beyond networks

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Deep Reinforcement Learning-aided Transmission Design for Energy-efficient Link Optimization in Vehicular Communications

Distribution of oxytetracycline in genital tract tissues of postpartum cows given the drug by intravenous and intrauterine routes.

Multi-Agent-Deep-Reinforcement-Learning-Enabled Offloading Scheme for Energy Minimization in Vehicle-to-Everything Communication Systems

Energy Efficiency-Oriented Joint Communication and Computation Resource Management in NOMA-Enabled V2X Underlaid Cellular Networks

Event-Triggered Reinforcement Learning Based Joint Resource Allocation for Ultra-Reliable Low-Latency V2X Communications

Joint Optimization of Spectrum and Energy Efficiency Considering the C-V2X Security: A Deep Reinforcement Learning Approach

Beam management optimization for V2V communications based on deep reinforcement learning

The know, do, and quality gaps in international maternal and child health care interventions.

Machine Learning Enables Radio Resource Allocation in the Downlink of Ultra-Low Latency Vehicular Networks

Semantic-Aware Resource Allocation Based on Deep Reinforcement Learning for 5G-V2X HetNets

Joint Task Offloading and Resource Optimization in NOMA-based Vehicular Edge Computing: A Game-Theoretic DRL Approach