Abstract:Emergency vehicle preemption (EVP) aims to provide the right-of-way to emergency vehicles (EVs) so that they can travel to the incident location efficiently. The travel time of EVs is the most important indicator of EVP efficiency, which should be minimized by distinct methods or algorithms. However, conventional EVP methods using strobe emitters, light emitters or sirens performs poorly in high-density vehicular traffic. Vehicle-to-everything (V2X) communication plays a pivotal role in intelligent transportation systems (ITS), which can assist EVs to travel safely and efficiently in connected autonomous transport systems (CATS). Enabled by V2X, this paper proposes a deep reinforcement learning-aided mobility-aware lane change algorithm (DRL-MLC) to enhance the efficiency of EVP. In the first stage, the EV learns to change lane based on a policy-based deep reinforcement learning (DRL) algorithm to find the shortest trajectory. In the second stage, autonomous vehicles (AVs) perform mobility-aware lane changing (MLC) to make way for the EV based on the emergency messages (EM) they received. Note that the performance of DRL-MLC strongly relies on the quality of service (QoS) of V2X, and improper network parameters of the on-board units (OBUs) that do not match with the vehicular density will significantly degrade the QoS. Therefore, in the third stage, the proposed algorithm fine-tunes specific parameters including communication range, carrier sensing range, packet rate, and contention window according to the real-time vehicular density based on a curve-fitting optimization method. Our results indicate that at medium-to-high density (e.g., 0.15 veh/m), the average speed of DRL-MLC has more than 49% average improvement than traditional lane changing models, and the ten-minute target travel time for EVs can be achieved by 95% with the proposed algorithm.

Enhancing the Minimum Awareness Failure Distance in V2X Communications: A Deep Reinforcement Learning Approach

Reinforcement Learning for Accident Risk-Adaptive V2X Networking

Deep Reinforcement Learning Based Mode Selection and Resource Allocation for Cellular V2X Communications

V2X-Lead: LiDAR-based End-to-End Autonomous Driving with Vehicle-to-Everything Communication Integration

Reinforcement Learning for Joint V2I Network Selection and Autonomous Driving Policies

A Novel Reinforcement Learning Method for Autonomous Driving with Intermittent Vehicle-to-Everything (V2X) Communications

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Multi-Agent RL Enables Decentralized Spectrum Access in Vehicular Networks

V2X and Deep Reinforcement Learning-Aided Mobility-Aware Lane Changing for Emergency Vehicle Preemption in Connected Autonomous Transport Systems

Deep Reinforcement Learning Algorithms for Hybrid V2X Communication: A Benchmarking Study

Event-Triggered Reinforcement Learning Based Joint Resource Allocation for Ultra-Reliable Low-Latency V2X Communications

Reinforcement Learning Based Vehicle-cell Association Algorithm for Highly Mobile Millimeter Wave Communication

Towards Socially Responsive Autonomous Vehicles: A Reinforcement Learning Framework with Driving Priors and Coordination Awareness

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Deep Reinforcement Learning Aided Platoon Control Relying on V2X Information

Beam management optimization for V2V communications based on deep reinforcement learning

Safe Driving Of Autonomous Vehicles Through Improved Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Distributed Vehicle Position Controls for Coverage Expansion in mmWave V2X

Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving

Deep-Reinforcement-Learning-Based Collision Avoidance of Autonomous Driving System for Vulnerable Road User Safety

Deep Reinforcement Learning for Resource Allocation in V2V Communications