Abstract:Efficient task offloading decision is a crucial technology in vehicular edge computing, which aims to fulfill the computational performance demands of complex vehicular tasks with respect to delay and energy consumption while minimizing network resource competition and consumption. Conventional distributed task offloading decisions rely solely on the local state of the vehicle, failing to optimize the utilization of the server's resources to its fullest potential. In addition, the mobility aspect of vehicles is often neglected in these decisions. In this paper, a cloud-edge-vehicle three-tier vehicular edge computing (VEC) system is proposed, where vehicles partially offload their computing tasks to edge or cloud servers while keeping the remaining tasks local to the vehicle terminals. Under the restrictions of vehicle mobility and discrete variables, task scheduling and task offloading proportion are jointly optimized with the objective of minimizing the total system cost. Considering the non-convexity, high-dimensional complex state and continuous action space requirements of the optimization problem, we propose a task offloading decision-making algorithm based on deep deterministic policy gradient (TODM_DDPG). TODM_DDPG algorithm adopts the actor–critic framework in which the actor network outputs floating point numbers to represent deterministic policy, while the critic network evaluates the action output by the actor network, and adjusts the network evaluation policy according to the rewards with the environment to maximize the long-term reward. To explore the algorithm performance, this conduct parameter setting experiments to correct the algorithm core hyper-parameters and select the optimal combination of parameters. In addition, in order to verify algorithm performance, we also carry out a series of comparative experiments with baseline algorithms. The results demonstrate that in terms of reducing system costs, the proposed algorithm outperforms the compared baseline algorithm, such as the deep Q network (DQN) and the actor–critic (AC), and the performance is improved by about 13% on average.

Twin delayed deep deterministic policy gradient-based intelligent computation offloading for IoT

Deep Deterministic Policy Gradient-Based Algorithm for Computation Offloading in IoV

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Task Offloading and Resource Allocation for Fog Computing in NG Wireless Networks: A Federated Deep Reinforcement Learning Approach

Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things

Towards Multi-Modal Deep Learning-Assisted Task Offloading for Consumer Electronic Devices Over An IoT-Fog Architecture

A Meta Reinforcement Learning-Based Task Offloading Strategy for IoT Devices in an Edge Cloud Computing Environment

Deep Reinforcement Learning-Based Computation Offloading and Resource Allocation in IoT

Computation Offloading and Resource Allocation Based on Distributed Deep Learning and Software Defined Mobile Edge Computing

DRL-Based Resource Allocation for Computation Offloading in IoV Networks

Task Offloading Decision-Making Algorithm for Vehicular Edge Computing: A Deep-Reinforcement-Learning-Based Approach

Intelligent Delay-Aware Partial Computing Task Offloading for Multi-User Industrial Internet of Things through Edge Computing

Dynamic Resource Allocation and Computation Offloading for IoT Fog Computing System

Age-of-Information-Based Computation Offloading and Transmission Scheduling in Mobile-Edge-Computing-Enabled IoT Networks

Task Offloading Based on LSTM Prediction and Deep Reinforcement Learning for Efficient Edge Computing in IoT

Energy-Delay Joint Optimization for Task Offloading in Digital Twin-Assisted Internet of Vehicles

Joint Computation Offloading and Resource Allocation for D2D-Assisted Mobile Edge Computing

Enhancing Service Offloading for Dense Networks Based on Optimal Stopping Theory in Virtual Mobile Edge Computing

Resource Allocation with Edge Computing in IoT Networks Via Machine Learning

A computational offloading optimization scheme based on deep reinforcement learning in perceptual network

Deep Reinforcement Learning-Based Computation Offloading for Servicing Dynamic Demand in Multi-UAV-Assisted IoT Network