Abstract:Mobile-edge computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on road side units (RSUs) that approximate to them. In this work, we consider an MEC-enabled vehicular edge network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge–end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multilayer deep reinforcement learning (DRL)-based approach, where each vehicle constructs and trains three modules to make different layers' decisions: 1) Offloading Module (first layer), determining whether to offload each task, by using the dueling and double deep Q-network (D3QN) framework; 2) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the parameterized deep Q-network (PDQN) framework; and 3) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%–90.53%.

A2C Deep Reinforcement Learning-based MEC Network for Offloading and Resource Allocation

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Offloading Strategy Based on Graph Neural Reinforcement Learning in Mobile Edge Computing

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Secure Deep Reinforcement Learning for Dynamic Resource Allocation in Wireless MEC Networks

Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach

Joint Server Selection, Cooperative Offloading and Handover in Multi-access Edge Computing Wireless Network: A Deep Reinforcement Learning Approach

Adaptive Task Offloading in Coded Edge Computing: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing

AI-Enabled Task Offloading for Improving Quality of Computational Experience in Ultra Dense Networks

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

DMADRL: A Distributed Multi-agent Deep Reinforcement Learning Algorithm for Cognitive Offloading in Dynamic MEC Networks

Decentralized Computation Offloading for Multi-User Mobile Edge Computing: A Deep Reinforcement Learning Approach

Priority-Aware Resource Allocation for RIS-assisted Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach

Intelligent Hybrid Resource Allocation in MEC-assisted RAN Slicing Network

A collaborative optimization strategy for computing offloading and resource allocation based on multi-agent deep reinforcement learning

Resource allocation algorithm for MEC based on Deep Reinforcement Learning

Joint computation offloading and resource allocation based on deep reinforcement learning in C-V2X edge computing

An Efficient Online Computation Offloading Approach for Large-Scale Mobile Edge Computing via Deep Reinforcement Learning