Abstract:The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers may not be ideal. Similarly, it may not be effective to design an a-priori cost function and then solve the optimal control problem in real-time. In order to address these issues and to avoid peculiar behaviors when encountering unforeseen scenario, we propose a reinforcement learning (RL) based method, where the ego car, i.e., an autonomous vehicle, learns to make decisions by directly interacting with simulated traffic. The decision maker for AV is implemented as a deep neural network providing an action choice for a given system state. In a critical application such as driving, an RL agent without explicit notion of safety may not converge or it may need extremely large number of samples before finding a reliable policy. To best address the issue, this paper incorporates reinforcement learning with an additional short horizon safety check (SC). In a critical scenario, the safety check will also provide an alternate safe action to the agent provided if it exists. This leads to two novel contributions. First, it generalizes the states that could lead to undesirable "near-misses" or "collisions ". Second, inclusion of safety check can provide a safe and stable training environment. This significantly enhances learning efficiency without inhibiting meaningful exploration to ensure safe and optimal learned behavior. We demonstrate the performance of the developed algorithm in highway driving scenario where the trained AV encounters varying traffic density in a highway setting.

Reinforcement Learning for Accident Risk-Adaptive V2X Networking

Reinforcement Learning for Joint V2I Network Selection and Autonomous Driving Policies

Enhancing the Minimum Awareness Failure Distance in V2X Communications: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

A Novel Reinforcement Learning Method for Autonomous Driving with Intermittent Vehicle-to-Everything (V2X) Communications

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Deep Q‐network learning‐based active speed management under autonomous driving environments

1 A Deep Reinforcement Learning Framework to Combat Dynamic Blockage in mmWave V2X Networks

Multi-Agent RL Enables Decentralized Spectrum Access in Vehicular Networks

An Intelligent Congestion Control Strategy in Heterogeneous V2X Based on Deep Reinforcement Learning

Event-Triggered Reinforcement Learning Based Joint Resource Allocation for Ultra-Reliable Low-Latency V2X Communications

Application of Hybrid Deep Reinforcement Learning for Managing Connected Cars at Pedestrian Crossings: Challenges and Research Directions

Multi-Agent Deep Reinforcement Learning for Cooperative Connected Vehicles

A deep reinforcement learning-based intelligent intervention framework for real-time proactive road safety management

Enhancing road safety through advanced predictive analytics in V2X communication networks

Autonomous Highway Driving using Deep Reinforcement Learning

Deep Reinforcement Learning Algorithms for Hybrid V2X Communication: A Benchmarking Study

ARSL-V: A risk-aware relay selection scheme using reinforcement learning in VANETs

V2X-Lead: LiDAR-based End-to-End Autonomous Driving with Vehicle-to-Everything Communication Integration

Emergency Collision Avoidance Decision-making for Autonomous Vehicles: A Model-based Reinforcement Learning Approach

Deep-Reinforcement-Learning-Based Distributed Vehicle Position Controls for Coverage Expansion in mmWave V2X