Abstract:Efficient task offloading decision is a crucial technology in vehicular edge computing, which aims to fulfill the computational performance demands of complex vehicular tasks with respect to delay and energy consumption while minimizing network resource competition and consumption. Conventional distributed task offloading decisions rely solely on the local state of the vehicle, failing to optimize the utilization of the server's resources to its fullest potential. In addition, the mobility aspect of vehicles is often neglected in these decisions. In this paper, a cloud-edge-vehicle three-tier vehicular edge computing (VEC) system is proposed, where vehicles partially offload their computing tasks to edge or cloud servers while keeping the remaining tasks local to the vehicle terminals. Under the restrictions of vehicle mobility and discrete variables, task scheduling and task offloading proportion are jointly optimized with the objective of minimizing the total system cost. Considering the non-convexity, high-dimensional complex state and continuous action space requirements of the optimization problem, we propose a task offloading decision-making algorithm based on deep deterministic policy gradient (TODM_DDPG). TODM_DDPG algorithm adopts the actor–critic framework in which the actor network outputs floating point numbers to represent deterministic policy, while the critic network evaluates the action output by the actor network, and adjusts the network evaluation policy according to the rewards with the environment to maximize the long-term reward. To explore the algorithm performance, this conduct parameter setting experiments to correct the algorithm core hyper-parameters and select the optimal combination of parameters. In addition, in order to verify algorithm performance, we also carry out a series of comparative experiments with baseline algorithms. The results demonstrate that in terms of reducing system costs, the proposed algorithm outperforms the compared baseline algorithm, such as the deep Q network (DQN) and the actor–critic (AC), and the performance is improved by about 13% on average.

Elevating Strategy with Cloud-Based Reinforcement Learning for Dynamic Decision-Making in Modern Enterprises

Energy Efficiency Strategy for Big Data in Cloud Environment Using Deep Reinforcement Learning

Research on Autonomous Driving Decision-making Strategies based Deep Reinforcement Learning

Intelligent Decision-Making of Load Balancing Using Deep Reinforcement Learning and Parallel PSO in Cloud Environment

A Deep Reinforcement Learning-Based Dynamic Computational Offloading Method for Cloud Robotics

Portfolio Management using Deep Reinforcement Learning

Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation via Deep Reinforcement Learning

Microservice Selection in Edge-Cloud Collaborative Environment: A Deep Reinforcement Learning Approach

Intelligent Cloud Resource Management with Deep Reinforcement Learning.

Deep Deterministic Portfolio Optimization

R-DDQN: Optimizing Algorithmic Trading Strategies Using a Reward Network in a Double DQN

Deep Reinforcement Learning Unleashing the Power of AI in Decision-Making

Decision Making in Monopoly Using a Hybrid Deep Reinforcement Learning Approach

A Deep Reinforcement Learning-Based Model for Optimal Resource Allocation and Task Scheduling in Cloud Computing

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility

Augmenting organizational decision-making with deep learning algorithms: Principles, promises, and challenges

Task Offloading Decision-Making Algorithm for Vehicular Edge Computing: A Deep-Reinforcement-Learning-Based Approach

Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning

A Hybrid Cloud and Edge Control Strategy for Demand Responses Using Deep Reinforcement Learning and Transfer Learning

Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolution

Improving the Performance of Autonomous Driving through Deep Reinforcement Learning