Abstract:With the rapid development of global automotive industry intelligence and networking, the Internet of Vehicles (IoV) service, as a key communication technology, has been faced with an increasing spectrum of resources shortage. In this paper, we consider a spectrum utilization problem, in which a number of co-existing cellular users (CUs) and prioritized device-to-device (D2D) users are equipped in a single antenna vehicle-mounted communication network. To ensure a business-aware spectrum access mechanism with delay granted in a complex dynamic environment, we consider optimizing a metric that maintains a trade off between maximizing the total capacity of vehicle to vehicle (V2V) and vehicle to infrastructure (V2I) links and minimizing the interference of high priority links. A low complexity priority-based spectrum allocation scheme based on the deep reinforcement learning method is developed to solve the proposed formulation. We trained our algorithm using the deep Q-learning network (DQN) over a set of public bandwidths. Simulation results show that the proposed scheme can allocate spectrum resources quickly and effectively in a high dynamic vehicle network environment. Concerning improved channel transmission rate, the V2V link rate in this scheme is 2.54 times that of the traditional random spectrum allocation scheme, and the V2I link rate is 13.5% higher than that of the traditional random spectrum allocation scheme. The average total interference received by priority links decreased by 14.2 dB compared to common links, realized service priority distinction and has good robustness to communication noise.

Coexistence of Cellular V2X and Wi-Fi over Unlicensed Spectrum with Reinforcement Learning

Cellular V2X in Unlicensed Spectrum: Harmonious Coexistence with VANET in 5G systems

Multi-Agent Reinforcement Learning-Based Decentralized Spectrum Access in Vehicular Networks with Emergent Communication

Extending 5G NR V2X Mode 2 to Enable Integrated Sensing and Communication for Vehicular Networks

Cellular V2X Communications in Unlicensed Spectrum: Harmonious Coexistence with VANET in 5G Systems

Cellular V2x Communications In Unlicensed Spectrum For 5g Networks

Multi-Agent Reinforcement Learning Based Unlicensed Resource Sharing for LTE-U Networks.

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Service Oriented Resource Management in Spatial Reuse-Based C-V2X Networks

BiLSTM Based Reinforcement Learning for Resource Allocation and User Association in LTE-U Networks

Deep Reinforcement Learning-Based Resource Allocation for Cellular Vehicular Network Mode 3 with Underlay Approach

An Intelligent Congestion Control Strategy in Heterogeneous V2X Based on Deep Reinforcement Learning

Two-Timescale Resource Management for Ultrareliable and Low-Latency Vehicular Communications

Semantic-Aware Resource Allocation Based on Deep Reinforcement Learning for 5G-V2X HetNets

Multi-Agent RL Enables Decentralized Spectrum Access in Vehicular Networks

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

QoE-Based Resource Allocation for Heterogeneous Multi-Radio Communication in Software-Defined Vehicle Networks

Deep Reinforcement Learning-Based Spectrum Allocation Algorithm in Internet of Vehicles Discriminating Services