Abstract:Mobile-edge computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on road side units (RSUs) that approximate to them. In this work, we consider an MEC-enabled vehicular edge network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge–end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multilayer deep reinforcement learning (DRL)-based approach, where each vehicle constructs and trains three modules to make different layers' decisions: 1) Offloading Module (first layer), determining whether to offload each task, by using the dueling and double deep Q-network (D3QN) framework; 2) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the parameterized deep Q-network (PDQN) framework; and 3) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%–90.53%.

Joint Optimization for MEC Computation Offloading and Resource Allocation in IoV Based on Deep Reinforcement Learning

Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Joint computation offloading and resource allocation for end-edge collaboration in internet of vehicles via multi-agent reinforcement learning

Joint Computation Offloading and Resource Allocation for Edge-Cloud Collaboration in Internet of Vehicles via Deep Reinforcement Learning

Distributed computation offloading method based on deep reinforcement learning in ICV

MEC-enabled resource allocation in Internet of Vehicles

Joint offloading decision and resource allocation in vehicular edge computing networks

Dynamic Offloading Method for Mobile Edge Computing of Internet of Vehicles Based on Multi-Vehicle Users and Multi-MEC Servers

Multi-mobile vehicles task offloading for vehicle-edge-cloud collaboration: A dependency-aware and deep reinforcement learning approach

Research on task offloading optimization strategies for vehicular networks based on game theory and deep reinforcement learning

Deep Reinforcement Learning-Based Task Offloading and Load Balancing for Vehicular Edge Computing

Computation offloading strategy based on deep reinforcement learning for connected and autonomous vehicle in vehicular edge computing

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

QoS-aware task offloading and resource allocation optimization in vehicular edge computing networks via MADDPG

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Deep Reinforcement Learning Based Computation Offloading in Heterogeneous MEC Assisted by Ground Vehicles and Unmanned Aerial Vehicles

Joint task offloading and resource allocation in vehicle-assisted multi-access edge computing

Joint Charging Scheduling and Computation Offloading in EV-Assisted Edge Computing: A Safe DRL Approach

DRL-based Task and Computational Offloading for Internet of Vehicles in Decentralized Computing

Deep Reinforcement Learning-Based Task Offloading for Vehicular Edge Computing With Flexible RSU-RSU Cooperation