Abstract:Efficient task offloading decision is a crucial technology in vehicular edge computing, which aims to fulfill the computational performance demands of complex vehicular tasks with respect to delay and energy consumption while minimizing network resource competition and consumption. Conventional distributed task offloading decisions rely solely on the local state of the vehicle, failing to optimize the utilization of the server's resources to its fullest potential. In addition, the mobility aspect of vehicles is often neglected in these decisions. In this paper, a cloud-edge-vehicle three-tier vehicular edge computing (VEC) system is proposed, where vehicles partially offload their computing tasks to edge or cloud servers while keeping the remaining tasks local to the vehicle terminals. Under the restrictions of vehicle mobility and discrete variables, task scheduling and task offloading proportion are jointly optimized with the objective of minimizing the total system cost. Considering the non-convexity, high-dimensional complex state and continuous action space requirements of the optimization problem, we propose a task offloading decision-making algorithm based on deep deterministic policy gradient (TODM_DDPG). TODM_DDPG algorithm adopts the actor–critic framework in which the actor network outputs floating point numbers to represent deterministic policy, while the critic network evaluates the action output by the actor network, and adjusts the network evaluation policy according to the rewards with the environment to maximize the long-term reward. To explore the algorithm performance, this conduct parameter setting experiments to correct the algorithm core hyper-parameters and select the optimal combination of parameters. In addition, in order to verify algorithm performance, we also carry out a series of comparative experiments with baseline algorithms. The results demonstrate that in terms of reducing system costs, the proposed algorithm outperforms the compared baseline algorithm, such as the deep Q network (DQN) and the actor–critic (AC), and the performance is improved by about 13% on average.

Vehicular Network Edge Intelligent Management : A Deep Deterministic Policy Gradient Approach for Service Offloading Decision.

Adaptive Task Offloading in Vehicular Edge Computing Networks Based on Deep Reinforcement Learning

Knowledge-Driven Service Offloading Decision for Vehicular Edge Computing: A Deep Reinforcement Learning Approach

NLDDPG Based Joint Optimization Decision Scheme for Vehicular Network Offloading and Resource Allocation

Multi-User Computation Offloading and Resource Allocation Algorithm in a Vehicular Edge Network

Adaptive Task Offloading in Vehicular Edge Computing Networks: a Reinforcement Learning Based Scheme

Task Offloading Decision-Making Algorithm for Vehicular Edge Computing: A Deep-Reinforcement-Learning-Based Approach

QoE-Based Task Offloading With Deep Reinforcement Learning in Edge-Enabled Internet of Vehicles

Joint offloading decision and resource allocation in vehicular edge computing networks

Federated Deep Reinforcement Learning Based Task Offloading with Power Control in Vehicular Edge Computing

V2N Service Scaling with Deep Reinforcement Learning

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

CU-DRL: A Novel Deep Reinforcement Learning-assisted Offloading Scheme for Supporting Vehicular Edge Computing

Hierarchical Reinforcement Learning Empowered Task Offloading in V2I Networks

Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV

Cloud-Edge–End Collaborative Task Offloading in Vehicular Edge Networks: A Multilayer Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Task Offloading for Vehicular Edge Computing With Flexible RSU-RSU Cooperation

Intelligent Vehicle Computation Offloading in Vehicular Ad Hoc Networks: A Multi-Agent LSTM Approach with Deep Reinforcement Learning

DNN Partitioning, Task Offloading, and Resource Allocation in Dynamic Vehicular Networks: A Lyapunov-Guided Diffusion-Based Reinforcement Learning Approach

Intelligent Driving Task Scheduling Service in Vehicle-Edge Collaborative Networks Based on Deep Reinforcement Learning

Deep Reinforcement Learning-Based Task Offloading and Load Balancing for Vehicular Edge Computing