Abstract:The high mobility of automobiles causes channel estimation uncertainties in vehicle-to-vehicle (V2V) communications. Moreover, scarce spectrum resources further bottlenecked the Quality of Service (QoS) in vehicular communication networks. Nonorthogonal multiple access (NOMA) technique is introduced to solve these problems, which reuses resource blocks (RBs) to improve the network's throughput and reduce latency with exploiting the power domain. In this article, we devise a multiagent reinforcement learning (MARL)-based resource allocation method for roadside units (RSUs) in vehicular communication networks. A joint sub-band scheduling and transmit power allocation problem is investigated, aiming to find rational and reasonable solutions at each RSU, under QoS constraints and power limits, from a global perspective. Due to the complicated structure of this high-dimensional optimization, it is extremely challenging to accomplish in polynomial time. The proposed method adopts MARL technique in RSUs to actualize collaboration and self-learning. RSUs act as agents, collectively interacting with the environment to maximize global energy efficiency, the ratio of the sum rate received at vehicles to the total power consumption of relevant RSUs, by trading-off between transmission rate and link interference. With distinctive observations and relevant feedback rewards, each agent learns to improve spectrum and power allocation by updating Q-networks using the gained experiences. The proposed method has much less complexity compared to the centralized implemented method, but still provides approximate performances. Simulation results demonstrate that the proposed method outperforms two existing baselines and a state-of-the-art power allocation scheme in terms of both average energy efficiency and probability of failure.

Joint Vehicle Association and Power Allocation for Energy Efficient Connected Automated Vehicles

Integrated sensing and communication enabled multiple beamwidth and power allocation for connected automated vehicles

Joint Power Control And User Pairing For Ergodic Capacity Maximization In V2v Communications

Design and Performance Evaluation of Joint Sensing and Communication Integrated System for 5G MmWave Enabled CAVs

Joint Phase Shift Design and Resource Management for a Non-Orthogonal Multiple Access-Enhanced Internet of Vehicle Assisted by an Intelligent Reflecting Surface-Equipped Unmanned Aerial Vehicle

Joint User Association, Power Allocation and ABS Deployment Optimization in Air-Ground Cooperative Networks

Joint Allocation of Wireless Resource and Computing Capability in MEC-Enabled Vehicular Network

Flexible Time Resource Allocation Method for Joint Communication and Sensing Enabled CAVs

Joint Resource Allocation and Power Control for V2V Communication of High-density Vehicle Network

Time-division ISAC Enabled Connected Automated Vehicles Cooperation Algorithm Design and Performance Evaluation

Efficient V2V Communication Scheme for 5G MmWave Hyper-Connected CAVs

Joint Resource Allocation and Interference Management for Vehicular Networks.

User Association, Subchannel and Power Allocation in Space-Air-Ground Integrated Vehicular Network with Delay Constraints

Two-Timescale Vehicle Association and Resource Management for C-V2X Networks

Energy-Efficient Resource Allocation for D2D-V2V Communication with Load Balancing

Joint Optimal Allocation of Wireless Resource and MEC Computation Capability in Vehicular Network

Intelligent Computation Offloading for Joint Communication and Sensing-Based Vehicular Networks

Joint Spectrum Resource Allocation and Power Control for LTE- V2V Communication

Joint V2V-Assisted Clustering, Caching, and Multicast Beamforming in Vehicular Edge Networks

Energy-Efficient Resource Allocation for V2X Communications

Vehicle Pairing, Spectrum Assignment and Power Control for Non-Safety Critical Services in Heterogeneous Vehicular Networks