Abstract:Mobile Edge Computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on Road Side Units (RSUs) that approximate to them. In this work, we consider an MEC-enabled Vehicular Edge Network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge-end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multi-layer Deep Reinforcement Learning (DRL) based approach, where each vehicle constructs and trains three modules to make different layers’ decisions: (i) Offloading Module (first layer), determining whether to offload each task, by using the Dueling and Double Deep Q-Network (D3QN) framework; (ii) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the Parameterized Deep Q-Network (PDQN) framework; and (iii) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%-90.53%.

Reinforcement Learning-Based Joint Task Offloading and Migration Schemes Optimization in Mobility-Aware MEC Network

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

Optimization of Lightweight Task Offloading Strategy for Mobile Edge Computing Based on Deep Reinforcement Learning

Mobility-Aware Computation Offloading with Adaptive Load Balancing in Small-Cell MEC

Dynamic Offloading Strategy for Delay-Sensitive Task in Mobile-Edge Computing Networks

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning

Joint Optimization of Service Migration and Resource Allocation in Mobile Edge–Cloud Computing

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Deep reinforcement learning-based task offloading and service migrating policies in service caching-assisted mobile edge computing

Context-Aware Online Offloading Strategy with Mobility Prediction for Mobile Edge Computing.

Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms

Mobility-Aware Resource Allocation in Multi-Access Edge Computing Using Deep Reinforcement Learning

A Bandwidth-Fair Migration-Enabled Task Offloading for Vehicular Edge Computing: a Deep Reinforcement Learning Approach

RMDDQN-Learning: Computation Offloading Algorithm Based on Dynamic Adaptive Multi -Objective Reinforcement Learning in Internet of Vehicles

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Security-Aware Task Offloading Using Deep Reinforcement Learning in Mobile Edge Computing Systems

Multi-Queue-Based Offloading Strategy for Deep Reinforcement Learning Tasks

Joint Service Migration and Resource Allocation in Edge IoT System Based on Deep Reinforcement Learning

Deep Reinforcement Learning Empowers Wireless Powered Mobile Edge Computing: Towards Energy-Aware Online Offloading