Abstract:A dynamic resource allocation scheme is proposed for vehicular edge computing networks in autonomous driving systems using deep reinforcement learning. This approach, leveraging double‐deep Q‐network, aims to maximize system revenue while balancing resource costs, system income, and security considerations. Simulation results demonstrate significant improvements in system rewards and reduced processing delay, guaranteeing system security compared to traditional greedy algorithms and value iteration methods. Autonomous vehicles navigating urban roads require technology that combines low latency with high computing power. The limited resources of the vehicle itself compel it to offload task requirements to edge server (ES) for processing assistance. However, as the number of vehicles continues to increase, how edge servers reasonably allocate limited resources to autonomous vehicles becomes critical to the success of urban intelligent transportation services. This paper establishes an urban road scenario with multiple autonomous vehicles and an edge computing server and considers two main driving behaviour transition resource requests, namely car‐following behaviour requests and lane‐changing behaviour requests. Simultaneously, acknowledging that vehicles may encounter unforeseen traffic hazards when switching driving behaviours, a safety redundancy setting strategy is employed to allocate additional resources to the vehicle to ensure safety and model the vehicle resource allocation problem in the autonomous driving system. Double‐deep Q‐network (DDQN) is then used to solve this model and maximize the total system utility by comprehensively considering resource costs, system revenue, and autonomous vehicle safety. Finally, results from the simulation experiment indicate that the proposed dynamic resource allocation scheme, based on deep reinforcement learning for autonomous vehicles under edge computing, not only greatly improves the system's benefits and reduces processing delays compared to traditional greedy algorithms and value iteration, but also effectively ensures security.

A Self-Optimization Method for System Service Dependability Based on Autonomic Computing

A Self-Adaptive Approach to Service Deployment under Mobile Edge Computing for Autonomous Driving.

Modeling, Analysis and Optimization of Dependability-Aware Energy Efficiency in Services Computing Systems

Self-reconfiguration of Service-Based Systems: a Case Study for Service Level Agreements and Resource Optimization

Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning

Multi-agent system based autonomic computing environment

Self-learning and Self-Adaptive Resource Allocation for Cloud-Based Software Services

Autonomic and Dependable Computing: Moving Towards a Model-Driven Approach

Optimization Service for Complex Process System in Grid Environment and Its Task Scheduling Strategy

Optimal Control Approach of Web Software Systems Based on User Experience

A Service Customize Routing Method Based on Software Defined Network Using Deep Q-Network

Dynamic Offloading Loading Optimization in distributed Fault Diagnosis system with Deep Reinforcement Learning Approach

Modeling and Analysis of Dependability Attributes for Services Computing Systems.

A Self-tuning Failure Detection Scheme for Cloud Computing Service

Optimization of battery charging and discharging strategies in substation DC systems using the dual self-attention network-N-BEATS model

Autonomic computing and incremental learning for the management of big services

Optimizing Network Service Continuity with Quality-Driven Resource Migration

Requirements-Driven Self-Optimization of Composite Services Using Feedback Control

Joint resource allocation and security redundancy for autonomous driving based on deep reinforcement learning algorithm

Self-Adaptive Trade-off Decision Making for Autoscaling Cloud-Based Services

A Proactive Self-Adaptation Approach Based on Ensemble Prediction for Service-Based Systems