Abstract:Grouping vehicles into platoons is a promising cooperative driving scenario to enhance the traffic safety and capacity of future vehicular networks. However, fast changing channel conditions in multi-platoon vehicular networks cause tremendous uncertainty for resource allocation. In addition, the unprecedented proliferation of various emerging vehicle-to-infrastructure (V2I) applications may result in some service demands with conflicting quality of experience. In this paper, we formulate a multi-objective resource allocation problem, which maximizes the transmission success rate of intra-platoon communications and the mean opinion score (MOS) of V2I communication links. To efficiently solve this multi-objective optimization problem, we resort to a deep reinforcement learning (DRL) framework. Specifically, we divide it into a set of scalar optimization subproblems based on the weighted sum approach and model each one as a partially observable stochastic game (P-OSG), where each platoon acts as an agent and the actions taken by all platoons correspond to the resource allocation solution. We further propose a Contribution-based Dual-Clip Proximal Policy Optimization (CD-PPO) algorithm to deal with each subproblem, which is a DRL algorithm based on the actor-critic framework. The network parameters of all subproblems are then optimized collaboratively by using the proposed training algorithm and the neighborhood parameter transfer strategy. The desired Pareto front is obtained when all the subproblems are solved. Simulation results reveal that proposed algorithm can outperform the other algorithms in terms of the MOS and transmission success rate.

Deep-Reinforcement-Learning-Based Computation Offloading and Power Allocation Within Dynamic Platoon Network

Deep Reinforcement Learning-Based Adaptive Computation Offloading and Power Allocation in Vehicular Edge Computing Networks

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Multi-Agent Deep Reinforcement Learning Based Collaborative Computation Offloading in Vehicular Edge Networks

Dynamic Computation Offloading for Platooning Vehicles: A Stochastic Game-Theoretic Approach

Deep Reinforcement Learning-based Computation Offloading in Vehicular Networks

Joint Optimization for MEC Computation Offloading and Resource Allocation in IoV Based on Deep Reinforcement Learning

Distributed V2V Computation Offloading Based on Dynamic Pricing Using Deep Reinforcement Learning.

A Computation Offloading Method with Distributed Double Deep Q‐network for Connected Vehicle Platooning with Vehicle‐to‐infrastructure Communications

Research on task offloading optimization strategies for vehicular networks based on game theory and deep reinforcement learning

NLDDPG Based Joint Optimization Decision Scheme for Vehicular Network Offloading and Resource Allocation

Cooperative Sensing and Task Offloading for Autonomous Platoons

Deep Reinforcement Learning for Multi-Objective Resource Allocation in Multi-Platoon Cooperative Vehicular Networks

Deep-Reinforcement-Learning-Based Distributed Computation Offloading in Vehicular Edge Computing Networks

A Dynamic Pricing-based Offloading and Resource Allocation Scheme with Data Security for Vehicle Platoon

Computation offloading strategy based on deep reinforcement learning for connected and autonomous vehicle in vehicular edge computing

DRL-Based Resource Allocation for Computation Offloading in IoV Networks

Multi-User Computation Offloading and Resource Allocation Algorithm in a Vehicular Edge Network

Delay-Effective Task Offloading Technology in Internet of Vehicles: From the Perspective of the Vehicle Platooning

An Extended Adaptive Large Neighbourhood Search for Vehicles' Task Offloading in Platooning

DRL-Based Hybrid Task Offloading and Resource Allocation in Vehicular Networks