Joint resource allocation and security redundancy for autonomous driving based on deep reinforcement learning algorithm
Han Zhang,Hongbin Liang,Lei Wang,Yiting Yao,Bin Lin,Dongmei Zhao
DOI: https://doi.org/10.1049/itr2.12489
IF: 2.7
2024-02-10
IET Intelligent Transport Systems
Abstract:A dynamic resource allocation scheme is proposed for vehicular edge computing networks in autonomous driving systems using deep reinforcement learning. This approach, leveraging double‐deep Q‐network, aims to maximize system revenue while balancing resource costs, system income, and security considerations. Simulation results demonstrate significant improvements in system rewards and reduced processing delay, guaranteeing system security compared to traditional greedy algorithms and value iteration methods. Autonomous vehicles navigating urban roads require technology that combines low latency with high computing power. The limited resources of the vehicle itself compel it to offload task requirements to edge server (ES) for processing assistance. However, as the number of vehicles continues to increase, how edge servers reasonably allocate limited resources to autonomous vehicles becomes critical to the success of urban intelligent transportation services. This paper establishes an urban road scenario with multiple autonomous vehicles and an edge computing server and considers two main driving behaviour transition resource requests, namely car‐following behaviour requests and lane‐changing behaviour requests. Simultaneously, acknowledging that vehicles may encounter unforeseen traffic hazards when switching driving behaviours, a safety redundancy setting strategy is employed to allocate additional resources to the vehicle to ensure safety and model the vehicle resource allocation problem in the autonomous driving system. Double‐deep Q‐network (DDQN) is then used to solve this model and maximize the total system utility by comprehensively considering resource costs, system revenue, and autonomous vehicle safety. Finally, results from the simulation experiment indicate that the proposed dynamic resource allocation scheme, based on deep reinforcement learning for autonomous vehicles under edge computing, not only greatly improves the system's benefits and reduces processing delays compared to traditional greedy algorithms and value iteration, but also effectively ensures security.
engineering, electrical & electronic,transportation science & technology