Abstract:Mobile Edge Computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on Road Side Units (RSUs) that approximate to them. In this work, we consider an MEC-enabled Vehicular Edge Network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge-end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multi-layer Deep Reinforcement Learning (DRL) based approach, where each vehicle constructs and trains three modules to make different layers’ decisions: (i) Offloading Module (first layer), determining whether to offload each task, by using the Dueling and Double Deep Q-Network (D3QN) framework; (ii) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the Parameterized Deep Q-Network (PDQN) framework; and (iii) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%-90.53%.

An Efficient Computation Offloading Strategy Based on Cloud-Edge Collaboration in Vehicular Edge Computing

Joint Optimization of Energy and Delay for Computation Offloading in Vehicular Edge Computing

Computation offloading strategy based on deep reinforcement learning for connected and autonomous vehicle in vehicular edge computing

Dynamic Offloading Method for Mobile Edge Computing of Internet of Vehicles Based on Multi-Vehicle Users and Multi-MEC Servers

Optimizing Task Offloading and Resource Allocation in Vehicular Edge Computing Based on Heterogeneous Cellular Networks

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach

Delay-Optimal Computation Offloading for Computation-Constrained Mobile Edge Networks.

Adaptive Task Offloading in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning

Dependency-Aware Task Offloading and Service Caching in Vehicular Edge Computing

Joint Optimization of Computation Offloading and Task Scheduling in Vehicular Edge Computing Networks

Computation Offloading and Resource Allocation for Cloud Assisted Mobile Edge Computing in Vehicular Networks.

Energy‐efficient Computation Offloading and Resource Allocation in Delay‐constrained Vehicular Edge Network

Deep Reinforcement Learning-Based Task Offloading and Load Balancing for Vehicular Edge Computing

Research on Cloud-Edge-End Collaborative Computing Offloading Strategy in the Internet of Vehicles Based on the M-TSA Algorithm

Computing Resource Allocation Strategy Based on Cloud-Edge Cluster Collaboration in Internet of Vehicles

Efficient Workload Allocation and User-Centric Utility Maximization for Task Scheduling in Collaborative Vehicular Edge Computing.

Multi-User Computation Offloading and Resource Allocation Algorithm in a Vehicular Edge Network

Contract-theoretic Approach for Delay Constrained Offloading in Vehicular Edge Computing Networks

A Game-Based Computation Offloading Method in Vehicular Multiaccess Edge Computing Networks

Incentive-driven Computation Offloading and Resource Pricing Strategy in Vehicular Edge Computing Assisted with Idle Mobile Vehicles