Abstract:Grouping vehicles into platoons is a promising cooperative driving scenario to enhance the traffic safety and capacity of future vehicular networks. However, fast changing channel conditions in multi-platoon vehicular networks cause tremendous uncertainty for resource allocation. In addition, the unprecedented proliferation of various emerging vehicle-to-infrastructure (V2I) applications may result in some service demands with conflicting quality of experience. In this paper, we formulate a multi-objective resource allocation problem, which maximizes the transmission success rate of intra-platoon communications and the mean opinion score (MOS) of V2I communication links. To efficiently solve this multi-objective optimization problem, we resort to a deep reinforcement learning (DRL) framework. Specifically, we divide it into a set of scalar optimization subproblems based on the weighted sum approach and model each one as a partially observable stochastic game (P-OSG), where each platoon acts as an agent and the actions taken by all platoons correspond to the resource allocation solution. We further propose a Contribution-based Dual-Clip Proximal Policy Optimization (CD-PPO) algorithm to deal with each subproblem, which is a DRL algorithm based on the actor-critic framework. The network parameters of all subproblems are then optimized collaboratively by using the proposed training algorithm and the neighborhood parameter transfer strategy. The desired Pareto front is obtained when all the subproblems are solved. Simulation results reveal that proposed algorithm can outperform the other algorithms in terms of the MOS and transmission success rate.

Deep Reinforcement Learning Based Intelligent Resource Allocation in Hybrid Vehicle Scenario

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

Multi-agent Reinforcement Learning Based Resource Allocation for Vehicular Networks.

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Federated Multi-Agent Deep Reinforcement Learning Approach for Resource Allocation in Platoon-Based NR-V2X

Deep Reinforcement Learning for Multi-Objective Resource Allocation in Multi-Platoon Cooperative Vehicular Networks

Computational Resource Sharing in a Vehicular Cloud Network Via Deep Reinforcement Learning

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Meta-Hierarchical Reinforcement Learning (Mhrl)-Based Dynamic Resource Allocation for Dynamic Vehicular Networks

Multi-agent Deep Reinforcement Learning Based Resource Management in Heterogeneous V2X Networks

Joint Resource Allocation and Interference Management for Vehicular Networks.

Reinforcement Learning-Based Resource Allocation for Multiple Vehicles with Communication-Assisted Sensing Mechanism

Resource Allocation in Vehicular Networks Based on Federated Multi-Agent Reinforcement Learning

Modeling Adaptive Platoon and Reservation Based Autonomous Intersection Control: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning Based Resource Allocation with Heterogeneous QoS for Cellular V2X.

Deep Reinforcement Learning Empowered Resource Allocation in Vehicular Fog Computing

Multi-Agent Deep Reinforcement Learning for Channel Resource Allocation in Vehicular Networks

Content Driven and Reinforcement Learning Based Resource Allocation Scheme in Vehicular Network.

Augmented Mixed Vehicular Platoon Control with Dense Communication Reinforcement Learning for Traffic Oscillation Alleviation

Learn to Allocate Resources in Vehicular Networks