Abstract:The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers may not be ideal. Similarly, it may not be effective to design an a-priori cost function and then solve the optimal control problem in real-time. In order to address these issues and to avoid peculiar behaviors when encountering unforeseen scenario, we propose a reinforcement learning (RL) based method, where the ego car, i.e., an autonomous vehicle, learns to make decisions by directly interacting with simulated traffic. The decision maker for AV is implemented as a deep neural network providing an action choice for a given system state. In a critical application such as driving, an RL agent without explicit notion of safety may not converge or it may need extremely large number of samples before finding a reliable policy. To best address the issue, this paper incorporates reinforcement learning with an additional short horizon safety check (SC). In a critical scenario, the safety check will also provide an alternate safe action to the agent provided if it exists. This leads to two novel contributions. First, it generalizes the states that could lead to undesirable "near-misses" or "collisions ". Second, inclusion of safety check can provide a safe and stable training environment. This significantly enhances learning efficiency without inhibiting meaningful exploration to ensure safe and optimal learned behavior. We demonstrate the performance of the developed algorithm in highway driving scenario where the trained AV encounters varying traffic density in a highway setting.

Adept Guide and Guard Reinforcement Learning for Safe Driving in Lane-Keeping Scenarios

A Reinforcement Learning Approach to Smart Lane Changes of Self-driving Cars

Safe reinforcement learning for autonomous vehicles to make lane-change decisions: Constraint based on Incomplete Information Game Theory

Safe Reinforcement Learning for Lane-Changing with Comprehensive Analysis of Safety Detection

A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning

Enhancing Autonomous Lane-Changing Safety: Deep Reinforcement Learning Via Pre-Exploration in Parallel Imaginary Environments

Decision Making of Autonomous Vehicles in Lane Change Scenarios: Deep Reinforcement Learning Approaches with Risk Awareness

Reinforcement Learning from Human Feedback for Lane Changing of Autonomous Vehicles in Mixed Traffic

Safe Decision-making for Lane-change of Autonomous Vehicles via Human Demonstration-aided Reinforcement Learning

Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change

Lane-keeping Control of Autonomous Vehicles Using Reinforcement Learning and Predictive Safety Filter *

Human Knowledge Enhanced Reinforcement Learning for Mandatory Lane-Change of Autonomous Vehicles in Congested Traffic

Reliable safety decision-making for autonomous vehicles: a safety assurance reinforcement learning

Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving

Autonomous Highway Driving using Deep Reinforcement Learning

Reinforcement Learning Based Safe Decision Making for Highway Autonomous Driving

DRNet: A Decision-Making Method for Autonomous Lane Changingwith Deep Reinforcement Learning

An Integrated Framework of Lateral and Longitudinal Behavior Decision-Making for Autonomous Driving Using Reinforcement Learning

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning

Deep Reinforcement Learning for Advanced Longitudinal Control and Collision Avoidance in High-Risk Driving Scenarios

Rule-based Reinforcement Learning for Lane Change Decision-making: A Risk Assessment Approach