Abstract:Mobile Edge Computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on Road Side Units (RSUs) that approximate to them. In this work, we consider an MEC-enabled Vehicular Edge Network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge-end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multi-layer Deep Reinforcement Learning (DRL) based approach, where each vehicle constructs and trains three modules to make different layers’ decisions: (i) Offloading Module (first layer), determining whether to offload each task, by using the Dueling and Double Deep Q-Network (D3QN) framework; (ii) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the Parameterized Deep Q-Network (PDQN) framework; and (iii) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%-90.53%.

Computational Resource Sharing in a Vehicular Cloud Network Via Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning enabled Computation Resource Allocation in a Vehicular Cloud Network

Reinforcement Learning for Resource Provisioning in Vehicular Cloud

Multi-agent Reinforcement Learning Based Resource Allocation for Vehicular Networks.

Cooperative Computation Offloading and Resource Management for Vehicle Platoon: A Deep Reinforcement Learning Approach.

DNN Partitioning, Task Offloading, and Resource Allocation in Dynamic Vehicular Networks: A Lyapunov-Guided Diffusion-Based Reinforcement Learning Approach

Federated Deep Reinforcement Learning-Based Task Allocation in Vehicular Fog Computing.

Deep Reinforcement Learning Empowered Resource Allocation in Vehicular Fog Computing

Multi-Agent Deep Reinforcement Learning for Channel Resource Allocation in Vehicular Networks

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

CU-DRL: A Novel Deep Reinforcement Learning-assisted Offloading Scheme for Supporting Vehicular Edge Computing

Deep Reinforcement Learning Based Intelligent Resource Allocation in Hybrid Vehicle Scenario

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach

Computation Offloading in a Cognitive Vehicular Networks with Vehicular Cloud Computing and Remote Cloud Computing

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

A Multi-Layer Deep Reinforcement Learning Approach for Joint Task Offloading and Scheduling in Vehicular Edge Networks.

DRL-Based Hybrid Task Offloading and Resource Allocation in Vehicular Networks

Mobility-Aware Partial Computation Offloading in Vehicular Networks: A Deep Reinforcement Learning Based Scheme

Resource Allocation in Vehicular Networks Based on Federated Multi-Agent Reinforcement Learning

Multiagent Deep-Reinforcement-Learning-Based Resource Allocation for Heterogeneous QoS Guarantees for Vehicular Networks

Service-Driven Resource Management in Vehicular Networks Based on Deep Reinforcement Learning