Abstract:The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers may not be ideal. Similarly, it may not be effective to design an a-priori cost function and then solve the optimal control problem in real-time. In order to address these issues and to avoid peculiar behaviors when encountering unforeseen scenario, we propose a reinforcement learning (RL) based method, where the ego car, i.e., an autonomous vehicle, learns to make decisions by directly interacting with simulated traffic. The decision maker for AV is implemented as a deep neural network providing an action choice for a given system state. In a critical application such as driving, an RL agent without explicit notion of safety may not converge or it may need extremely large number of samples before finding a reliable policy. To best address the issue, this paper incorporates reinforcement learning with an additional short horizon safety check (SC). In a critical scenario, the safety check will also provide an alternate safe action to the agent provided if it exists. This leads to two novel contributions. First, it generalizes the states that could lead to undesirable "near-misses" or "collisions ". Second, inclusion of safety check can provide a safe and stable training environment. This significantly enhances learning efficiency without inhibiting meaningful exploration to ensure safe and optimal learned behavior. We demonstrate the performance of the developed algorithm in highway driving scenario where the trained AV encounters varying traffic density in a highway setting.

Leveraging on Deep Reinforcement Learning for Autonomous Safe Decision-Making in Highway On-ramp Merging (Student Abstract)

Novel Decision-Making Strategy for Connected and Autonomous Vehicles in Highway On-Ramp Merging

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

On-Ramp Merging for Highway Autonomous Driving: An Application of a New Safety Indicator in Deep Reinforcement Learning

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

A Deep Reinforcement Learning-Based Approach for Autonomous Driving in Highway On-Ramp Merge

Autonomous On-ramp Merge Strategy Using Deep Reinforcement Learning in Uncertain Highway Environment

Formulation of Deep Reinforcement Learning Architecture Toward Autonomous Driving for On-Ramp Merge

Deep Reinforcement Learning Based Decision-Making Strategy of Autonomous Vehicle in Highway Uncertain Driving Environments

Reinforcement Learning Based Safe Decision Making for Highway Autonomous Driving

Autonomous Highway Driving using Deep Reinforcement Learning

Deep Reinforcement Learning with Enhanced Safety for Autonomous Highway Driving

Implicit Sensing in Traffic Optimization: Advanced Deep Reinforcement Learning Techniques

Deep Multi-agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic

Prediction Based Decision Making for Autonomous Highway Driving

Dueling Deep Q Network for Highway Decision Making in Autonomous Vehicles: A Case Study

Investigating Autonomous Vehicle Driving Strategies in Highway Ramp Merging Zones

A Safe and Efficient Lane Change Decision-Making Strategy of Autonomous Driving Based on Deep Reinforcement Learning

Towards Robust Decision-Making for Autonomous Highway Driving Based on Safe Reinforcement Learning

Reinforcement Learning with Latent State Inference for Autonomous On-ramp Merging under Observation Delay

A Systematic Study of Multi-Agent Deep Reinforcement Learning for Safe and Robust Autonomous Highway Ramp Entry