Abstract:Mobile Edge Computing (MEC) is a promising computing scheme to support computation-intensive AI applications in vehicular networks, by enabling vehicles to offload computation tasks to edge computing servers deployed on Road Side Units (RSUs) that approximate to them. In this work, we consider an MEC-enabled Vehicular Edge Network (VEN), where each vehicle can offload tasks to edge/cloud computing servers via vehicle-to-infrastructure (V2I) links or to other end-vehicles via vehicle-to-vehicle (V2V) links. In such a cloud-edge-end collaborative offloading scenario, we focus on the joint task offloading, scheduling, and resource allocation problem for vehicles, which is challenging due to the online and asynchronous decision-making requirement for each task. To solve the problem, we propose a Multi-layer Deep Reinforcement Learning (DRL) based approach, where each vehicle constructs and trains three modules to make different layers’ decisions: (i) Offloading Module (first layer), determining whether to offload each task, by using the Dueling and Double Deep Q-Network (D3QN) framework; (ii) Scheduling Module (second layer), determining where and how to offload each task in the offloading queues, together with the transmission power, by using the Parameterized Deep Q-Network (PDQN) framework; and (iii) Computing Module (third layer), determining how much computing resource to be allocated for each task in the computation queues, by using classic optimization techniques. We provide the detailed algorithm design and perform extensive simulations to evaluate its performance. Simulation results show that our proposed algorithm outperforms the existing algorithms in the literature, and can reduce the average cost by 25.86%–72.51% and increase the average satisfaction rate by 3.48%-90.53%.

Iraf: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks.

Priority-Aware Resource Allocation for RIS-assisted Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing

DeepEdge: A New QoE-Based Resource Allocation Framework Using Deep Reinforcement Learning for Future Heterogeneous Edge-IoT Applications

Deep Reinforcement Learning for Multi-Functional RIS-Aided Over-the-Air Federated Learning in Internet of Robotic Things

Mobility-Aware Resource Allocation in Multi-Access Edge Computing Using Deep Reinforcement Learning

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Joint Computation Offloading and Resource Allocation for Edge-Cloud Collaboration in Internet of Vehicles via Deep Reinforcement Learning

Joint Service Migration and Resource Allocation in Edge IoT System Based on Deep Reinforcement Learning

MEC-enabled resource allocation in Internet of Vehicles

Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things

Deep Reinforcement Learning for Computation and Communication Resource Allocation in Multiaccess MEC Assisted Railway IoT Networks

Distributed Resource Scheduling for Large-Scale MEC Systems: A Multiagent Ensemble Deep Reinforcement Learning With Imitation Acceleration

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Joint Computation Offloading and Resource Allocation in Multi-edge Smart Communities with Personalized Federated Deep Reinforcement Learning

Optimal Computation Resource Allocation in Energy-Efficient Edge IoT Systems with Deep Reinforcement Learning

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Reconfigurable Intelligent Surface Assisted Mobile Edge Computing With Heterogeneous Learning Tasks

Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System

Cloud-Edge-End Collaborative Task Offloading in Vehicular Edge Networks: A Multi-Layer Deep Reinforcement Learning Approach