Abstract:Mobile-edge computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on road side units (RSUs) that approximate to them. In this work, we consider an MEC-enabled vehicular edge network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge–end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multilayer deep reinforcement learning (DRL)-based approach, where each vehicle constructs and trains three modules to make different layers' decisions: 1) Offloading Module (first layer), determining whether to offload each task, by using the dueling and double deep Q-network (D3QN) framework; 2) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the parameterized deep Q-network (PDQN) framework; and 3) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%–90.53%.

Reinforcement Learning Based Computation Migration for Vehicular Cloud Computing

Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based Scheme

Adaptive Task Offloading in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning

A Joint Service Migration and Mobility Optimization Approach for Vehicular Edge Computing

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Computation offloading strategy based on deep reinforcement learning for connected and autonomous vehicle in vehicular edge computing

Deep Reinforcement Learning-Based V2V Partial Computation Offloading in Vehicular Fog Computing

Learning-Based Task Offloading for Vehicular Cloud Computing Systems

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

Federated Deep Reinforcement Learning-Based Task Allocation in Vehicular Fog Computing.

Distributed V2V Computation Offloading Based on Dynamic Pricing Using Deep Reinforcement Learning.

Learning Based Energy Efficient Task Offloading for Vehicular Collaborative Edge Computing

Revenue and Energy Efficiency-Driven Delay Constrained Computing Task Offloading and Resource Allocation in a Vehicular Edge Computing Network: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks

Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing

Task Collaborative Offloading Scheme in Vehicle Multi-Access Edge Computing Network

A Delay-Optimal Task Scheduling Strategy for Vehicle Edge Computing Based on the Multi-Agent Deep Reinforcement Learning Approach

Asynchronous Deep Reinforcement Learning for Collaborative Task Computing and On-Demand Resource Allocation in Vehicular Edge Computing

Collaborative Mobile Computation Offloading to Vehicle-Based Cloudlets

Intelligent Vehicle Computation Offloading in Vehicular Ad Hoc Networks: A Multi-Agent LSTM Approach with Deep Reinforcement Learning

Priority-Aware Task Offloading in Vehicular Fog Computing Based on Deep Reinforcement Learning