Abstract:Mobile-edge computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on road side units (RSUs) that approximate to them. In this work, we consider an MEC-enabled vehicular edge network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge–end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multilayer deep reinforcement learning (DRL)-based approach, where each vehicle constructs and trains three modules to make different layers' decisions: 1) Offloading Module (first layer), determining whether to offload each task, by using the dueling and double deep Q-network (D3QN) framework; 2) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the parameterized deep Q-network (PDQN) framework; and 3) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%–90.53%.

Heterogeneous Markov Decision Process Model for Joint Resource Allocation and Task Scheduling in Network Slicing Enabled Internet of Vehicles

SMDP-based Resource Allocation for Video Streaming in Cognitive Vehicular Networks.

Autonomous Resource Slicing for Virtualized Vehicular Networks With D2D Communications Based on Deep Reinforcement Learning

QoS Guaranteed Network Slicing Orchestration for Internet of Vehicles

Joint URLLC Traffic Scheduling and Resource Allocation for Semantic Communication Systems

Network Slicing Enabled Resource Management for Service-Oriented Ultra-Reliable and Low-Latency Vehicular Networks

Dynamic RAN Slicing for Service-Oriented Vehicular Networks via Constrained Learning

MEC-enabled resource allocation in Internet of Vehicles

Joint offloading decision and resource allocation in vehicular edge computing networks

DRL-Based Resource Allocation for Computation Offloading in IoV Networks

Deep Learning Based Joint Resource Scheduling Algorithms for Hybrid MEC Networks

NLDDPG Based Joint Optimization Decision Scheme for Vehicular Network Offloading and Resource Allocation

Unleashing the Potential of Stage-Wise Decision-Making in Scheduling of Graph-Structured Tasks over Mobile Vehicular Clouds

Multi-Task Driven User Association and Resource Allocation in In-vehicle Networks

Deep Reinforcement Learning for Multi-Objective Resource Allocation in Multi-Platoon Cooperative Vehicular Networks

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Multi-Agent Deep Reinforcement Learning Based Resource Allocation for Ultra-Reliable Low-Latency Internet of Controllable Things

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

Network Slicing with MEC and Deep Reinforcement Learning for the Internet of Vehicles

Distributed Handoff Problem in Heterogeneous Networks With End-to-End Network Slicing: Decentralized Markov Decision Process-Based Modeling and Solution

Intelligent Resource Slicing for eMBB and URLLC Coexistence in 5G and Beyond: A Deep Reinforcement Learning Based Approach