Abstract:Mobile Edge Computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on Road Side Units (RSUs) that approximate to them. In this work, we consider an MEC-enabled Vehicular Edge Network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge-end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multi-layer Deep Reinforcement Learning (DRL) based approach, where each vehicle constructs and trains three modules to make different layers’ decisions: (i) Offloading Module (first layer), determining whether to offload each task, by using the Dueling and Double Deep Q-Network (D3QN) framework; (ii) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the Parameterized Deep Q-Network (PDQN) framework; and (iii) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%-90.53%.

Edge Computing Task Offloading Optimization for a UAV-assisted Internet of Vehicles Via Deep Reinforcement Learning

Adaptive Task Offloading in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Distributed Computation Offloading in Vehicular Edge Computing Networks

Priority-Aware Task Offloading in UAV-Assisted Vehicular Network Via Deep Reinforcement Learning

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network

Latency-aware task offloading in UAV-assisted edge computing: Leveraging deep reinforcement learning

Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based Scheme

Deep Reinforcement Learning-Driven Adaptive Task Offloading and Resource Allocation for UAV-Assisted Mobile Edge Computing

Deep Reinforcement Learning for Scheduling and Offloading in UAV-Assisted Mobile Edge Networks

Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach

UAV-Aided Partial Task Offloading for Integrated Sensing, Computation, and Communications Systems via Deep Reinforcement Learning

Task Offloading Strategy for Unmanned Aerial Vehicle Power Inspection Based on Deep Reinforcement Learning

Collaborative Optimization Strategy for Dependent Task Offloading in Vehicular Edge Computing

Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-assisted Mobile Edge Computing

Deep Reinforcement Learning for Task Offloading in Vehicular Edge Computing

Deep reinforcement learning based computing offloading in unmanned aerial vehicles for disaster management

QoE-Based Task Offloading With Deep Reinforcement Learning in Edge-Enabled Internet of Vehicles

Communication-Assisted Multi-Agent Reinforcement Learning Improves Task-Offloading in UAV-Aided Edge-Computing Networks

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Computation offloading optimization for UAV-assisted mobile edge computing: a deep deterministic policy gradient approach