Abstract:Grouping vehicles into platoons is a promising cooperative driving scenario to enhance the traffic safety and capacity of future vehicular networks. However, fast changing channel conditions in multi-platoon vehicular networks cause tremendous uncertainty for resource allocation. In addition, the unprecedented proliferation of various emerging vehicle-to-infrastructure (V2I) applications may result in some service demands with conflicting quality of experience. In this paper, we formulate a multi-objective resource allocation problem, which maximizes the transmission success rate of intra-platoon communications and the mean opinion score (MOS) of V2I communication links. To efficiently solve this multi-objective optimization problem, we resort to a deep reinforcement learning (DRL) framework. Specifically, we divide it into a set of scalar optimization subproblems based on the weighted sum approach and model each one as a partially observable stochastic game (P-OSG), where each platoon acts as an agent and the actions taken by all platoons correspond to the resource allocation solution. We further propose a Contribution-based Dual-Clip Proximal Policy Optimization (CD-PPO) algorithm to deal with each subproblem, which is a DRL algorithm based on the actor-critic framework. The network parameters of all subproblems are then optimized collaboratively by using the proposed training algorithm and the neighborhood parameter transfer strategy. The desired Pareto front is obtained when all the subproblems are solved. Simulation results reveal that proposed algorithm can outperform the other algorithms in terms of the MOS and transmission success rate.

Content Driven and Reinforcement Learning Based Resource Allocation Scheme in Vehicular Network.

A Content Driven Resource Allocation Scheme for Video Transmission in Vehicular Networks

SMDP-based Resource Allocation for Video Streaming in Cognitive Vehicular Networks.

Channel Allocation for Adaptive Video Streaming in Vehicular Networks

Resource Allocation for Video Streaming in Heterogeneous Cognitive Vehicular Networks.

Deep Reinforcement Learning Based Intelligent Resource Allocation in Hybrid Vehicle Scenario

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Resource Allocation in Vehicular Networks Based on Offline Reinforcement Learning

Joint Spectrum Allocation and Power Control in Vehicular Networks Based on Reinforcement Learning.

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based Scheme

Resource Allocation in Vehicular Networks Based on Federated Multi-Agent Reinforcement Learning

Two-Timescale Resource Management for Ultrareliable and Low-Latency Vehicular Communications

Learn to Allocate Resources in Vehicular Networks

Multiple QoS Enabled Intelligent Resource Management in Vehicle-to-Vehicle Communication

Deep Reinforcement Learning for Multi-Objective Resource Allocation in Multi-Platoon Cooperative Vehicular Networks

Resource Allocation for Delay-Sensitive Vehicle-to-Multi-Edges (v2es) Communications in Vehicular Networks: A Multi-Agent Deep Reinforcement Learning Approach.

Reinforcement Learning Based Prioritized Cross-Area Resource Management For Vehicular Cloud Networks

A Deep Learning Based Resource Allocation Scheme in Vehicular Communication Systems

Intelligent Resource Allocation Management for Vehicles Network: an A3C Learning Approach.

Deep Reinforcement Learning-Based Resource Allocation for Cellular Vehicular Network Mode 3 with Underlay Approach