Abstract:A dynamic resource allocation scheme is proposed for vehicular edge computing networks in autonomous driving systems using deep reinforcement learning. This approach, leveraging double‐deep Q‐network, aims to maximize system revenue while balancing resource costs, system income, and security considerations. Simulation results demonstrate significant improvements in system rewards and reduced processing delay, guaranteeing system security compared to traditional greedy algorithms and value iteration methods. Autonomous vehicles navigating urban roads require technology that combines low latency with high computing power. The limited resources of the vehicle itself compel it to offload task requirements to edge server (ES) for processing assistance. However, as the number of vehicles continues to increase, how edge servers reasonably allocate limited resources to autonomous vehicles becomes critical to the success of urban intelligent transportation services. This paper establishes an urban road scenario with multiple autonomous vehicles and an edge computing server and considers two main driving behaviour transition resource requests, namely car‐following behaviour requests and lane‐changing behaviour requests. Simultaneously, acknowledging that vehicles may encounter unforeseen traffic hazards when switching driving behaviours, a safety redundancy setting strategy is employed to allocate additional resources to the vehicle to ensure safety and model the vehicle resource allocation problem in the autonomous driving system. Double‐deep Q‐network (DDQN) is then used to solve this model and maximize the total system utility by comprehensively considering resource costs, system revenue, and autonomous vehicle safety. Finally, results from the simulation experiment indicate that the proposed dynamic resource allocation scheme, based on deep reinforcement learning for autonomous vehicles under edge computing, not only greatly improves the system's benefits and reduces processing delays compared to traditional greedy algorithms and value iteration, but also effectively ensures security.

Deep Reinforcement Learning Based Multi-attribute Auction Model for Resource Allocation in Vehicular AIGC Services

Multi-attribute Auction-based Resource Allocation for Twins Migration in Vehicular Metaverses: A GPT-based DRL Approach

A Learning-based Incentive Mechanism for Mobile AIGC Service in Decentralized Internet of Vehicles

Multi-Agent Reinforcement Learning for Long-Term Network Resource Allocation through Auction: a V2X Application

Diffusion-based Auction Mechanism for Efficient Resource Management in 6G-enabled Vehicular Metaverses

Deep Reinforcement Learning for Multi-Objective Resource Allocation in Multi-Platoon Cooperative Vehicular Networks

Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks

Deep Learning based Wireless Resource Allocation with Application to Vehicular Networks

Intelligent Cruise Guidance and Vehicle Resource Management With Deep Reinforcement Learning

Adaptive Resource Allocation of Vehicles under Dynamic Environment

Auction-Based Consensus of Autonomous Vehicles for Multi-Target Dynamic Task Allocation and Path Planning in an Unknown Obstacle Environment

Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch

Dynamic Digital Twin and Distributed Incentives for Resource Allocation in Aerial-Assisted Internet of Vehicles

A Truthful Auction for Graph Job Allocation in Vehicular Cloud-assisted Networks

DNN Partitioning, Task Offloading, and Resource Allocation in Dynamic Vehicular Networks: A Lyapunov-Guided Diffusion-Based Reinforcement Learning Approach

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

Modeling Adaptive Platoon and Reservation Based Autonomous Intersection Control: A Deep Reinforcement Learning Approach

Reinforcement Learning-Based Resource Allocation for Multiple Vehicles with Communication-Assisted Sensing Mechanism

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks

Joint resource allocation and security redundancy for autonomous driving based on deep reinforcement learning algorithm