Abstract:A dynamic resource allocation scheme is proposed for vehicular edge computing networks in autonomous driving systems using deep reinforcement learning. This approach, leveraging double‐deep Q‐network, aims to maximize system revenue while balancing resource costs, system income, and security considerations. Simulation results demonstrate significant improvements in system rewards and reduced processing delay, guaranteeing system security compared to traditional greedy algorithms and value iteration methods. Autonomous vehicles navigating urban roads require technology that combines low latency with high computing power. The limited resources of the vehicle itself compel it to offload task requirements to edge server (ES) for processing assistance. However, as the number of vehicles continues to increase, how edge servers reasonably allocate limited resources to autonomous vehicles becomes critical to the success of urban intelligent transportation services. This paper establishes an urban road scenario with multiple autonomous vehicles and an edge computing server and considers two main driving behaviour transition resource requests, namely car‐following behaviour requests and lane‐changing behaviour requests. Simultaneously, acknowledging that vehicles may encounter unforeseen traffic hazards when switching driving behaviours, a safety redundancy setting strategy is employed to allocate additional resources to the vehicle to ensure safety and model the vehicle resource allocation problem in the autonomous driving system. Double‐deep Q‐network (DDQN) is then used to solve this model and maximize the total system utility by comprehensively considering resource costs, system revenue, and autonomous vehicle safety. Finally, results from the simulation experiment indicate that the proposed dynamic resource allocation scheme, based on deep reinforcement learning for autonomous vehicles under edge computing, not only greatly improves the system's benefits and reduces processing delays compared to traditional greedy algorithms and value iteration, but also effectively ensures security.

Security computing resource allocation based on deep reinforcement learning in serverless multi-cloud edge computing

Deep Reinforcement Learning Based Resource Allocation Strategy in Cloud-Edge Computing System

Deep reinforcement learning based resource allocation in edge-cloud gaming

Deep-Reinforcement-Learning-Based Resource Allocation for Cloud Gaming via Edge Computing

Deep Reinforcement Learning-Based Resource Allocation for Content Distribution in IoT-Edge-Cloud Computing Environments

Computation Offloading in Resource-constrained Edge Computing Systems based on Deep Reinforcement Learning

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Security-Aware Task Offloading Using Deep Reinforcement Learning in Mobile Edge Computing Systems

A Deep Reinforcement Learning-Based Model for Optimal Resource Allocation and Task Scheduling in Cloud Computing

A DRL-Driven Intelligent Optimization Strategy for Resource Allocation in Cloud-Edge-End Cooperation Environments

Deep Reinforcement Learning based Approach for Online Service Placement and Computation Resource Allocation in Edge Computing

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

Deep reinforcement learning-based resource scheduling for energy optimization and load balancing in SDN-driven edge computing

DRL‐based computing offloading approach for large‐scale heterogeneous tasks in mobile edge computing

Dynamical Resource Allocation in Edge for Trustable Internet-of-Things Systems: A Reinforcement Learning Method

Two-tiered Online Optimization of Region-wide Datacenter Resource Allocation via Deep Reinforcement Learning

Energy-Efficient Collaborative Multi-Access Edge Computing Via Deep Reinforcement Learning

Delay-aware and Energy-Efficient Computation Offloading in Mobile Edge Computing Using Deep Reinforcement Learning

Joint Optimization of Service Migration and Resource Allocation in Mobile Edge–Cloud Computing

Joint resource allocation and security redundancy for autonomous driving based on deep reinforcement learning algorithm

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond