Abstract:Vehicular edge computing (VEC) is a new computing paradigm that has great potential to enhance the capability of vehicle terminals (VTs) to support resource-hungry in-vehicle applications with low latency and high energy efficiency. In this article, we investigate an important computation offloading scheduling problem in a typical VEC scenario, where a VT traveling along an expressway intends to schedule its tasks waiting in the queue to minimize the long-term cost in terms of a tradeoff between task latency and energy consumption. Due to diverse task characteristics, dynamic wireless environment, and frequent handover events caused by vehicle movements, an optimal solution should take into account both where to schedule (i.e., local computation or offloading) and when to schedule (i.e., the order and time for execution) each task. To solve such a complicated stochastic optimization problem, we model it by a carefully designed Markov decision process (MDP) and resort to deep reinforcement learning (DRL) to deal with the enormous state space. Our DRL implementation is designed based on the state-of-the-art proximal policy optimization (PPO) algorithm. A parameter-shared network architecture combined with a convolutional neural network (CNN) is utilized to approximate both policy and value function, which can effectively extract representative features. A series of adjustments to the state and reward representations are taken to further improve the training efficiency. Extensive simulation experiments and comprehensive comparisons with six known baseline algorithms and their heuristic combinations clearly demonstrate the advantages of the proposed DRL-based offloading scheduling method.

Asynchronous Deep Reinforcement Learning for Collaborative Task Computing and On-Demand Resource Allocation in Vehicular Edge Computing

Collaborative Task Offloading for Vehicular Edge Computing

Adaptive Task Offloading in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning

Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based Scheme

Deep Reinforcement Learning-Based Adaptive Computation Offloading and Power Allocation in Vehicular Edge Computing Networks

Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks

Collaborative Data Scheduling for Vehicular Edge Computing via Deep Reinforcement Learning

Deep Reinforcement Learning-Based Task Offloading and Load Balancing for Vehicular Edge Computing

Mobility-Aware Cooperative Task Offloading and Resource Allocation in Vehicular Edge Computing.

Multi-Agent Deep Reinforcement Learning Based Collaborative Computation Offloading in Vehicular Edge Networks

Deep-Reinforcement-Learning-Based Offloading Scheduling for Vehicular Edge Computing

Revenue and Energy Efficiency-Driven Delay Constrained Computing Task Offloading and Resource Allocation in a Vehicular Edge Computing Network: A Deep Reinforcement Learning Approach

Joint Intelligent Optimization of Task Offloading and Service Caching for Vehicular Edge Computing

Learning Based Energy Efficient Task Offloading for Vehicular Collaborative Edge Computing

Joint Task Offloading and Resources Allocation for Hybrid Vehicle Edge Computing Systems

Deep Reinforcement Learning-Based Task Offloading for Vehicular Edge Computing With Flexible RSU-RSU Cooperation

Deep Reinforcement Learning for Task Offloading in Vehicular Edge Computing

Efficient Workload Allocation and User-Centric Utility Maximization for Task Scheduling in Collaborative Vehicular Edge Computing.

Adaptive Inference Reinforcement Learning for Task Offloading in Vehicular Edge Computing Systems

Heterogeneous Task Oriented Data Scheduling in Vehicular Edge Computing Via Deep Reinforcement Learning

Mean-field reinforcement learning for decentralized task offloading in vehicular edge computing