Abstract:Deep reinforcement learning (DRL) has a great potential for solving complex decision-making problems in autonomous driving, especially in mixed-traffic scenarios where autonomous vehicles and human-driven vehicles (HDVs) drive together. Safety is a key during both the learning and deploying reinforcement learning (RL) algorithms process. In this paper, we formulate the on-ramp merging as a Markov Decision Process (MDP) problem and solve it with an off-policy RL algorithm, i.e., Soft Actor-Critic for Discrete Action Settings (SAC-Discrete). In addition, a motion predictive safety controller including a motion predictor and an action substitution module, is proposed to ensure driving safety during both training and testing. The motion predictor estimates the trajectories of the ego vehicle and surrounding vehicles from kinematic models, and predicts potential collisions. The action substitution module updates the actions based on safety distance and replaces risky actions, before sending them to the low-level controller. We train, evaluate and test our approach on a gym-like highway simulation with three different levels of traffic modes. The simulation results show that even in harder traffic densities, our proposed method still significantly reduces collision rate while maintaining high efficiency, outperforming several state-of-the-art baselines in the considered on-ramp merging scenarios. The video demo of the evaluation process can be found at: <a class="link-external link-https" href="https://www.youtube.com/watch?v=7FvjbAM4oFw" rel="external noopener nofollow">this https URL</a>

Hierarchical Reinforcement Learning Combined with Motion Primitives for Automated Overtaking.

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

A Fuzzy-Inference-based Reinforcement Learning Method of Overtaking Decision Making for Automated Vehicles

Action and Trajectory Planning for Urban Autonomous Driving with Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning for Self-Driving Decision-Making without Reliance on Labeled Driving Data

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

HR-Planner: A Hierarchical Highway Tactical Planner Based on Residual Reinforcement Learning

Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning

Hierarchical framework integrating rapidly-exploring random tree with deep reinforcement learning for autonomous vehicle

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

Task-Driven Autonomous Driving: Balanced Strategies Integrating Curriculum Reinforcement Learning and Residual Policy

A Deep Reinforcement Learning Based Approach for Autonomous Overtaking

HARL: A Novel Hierachical Adversary Reinforcement Learning for Automoumous Intersection Management

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning

Let Hybrid A* Path Planner Obey Traffic Rules: A Deep Reinforcement Learning-Based Planning Framework

Safe-State Enhancement Method for Autonomous Driving Via Direct Hierarchical Reinforcement Learning.

HGRL: Human-Driving-Data Guided Reinforcement Learning for Autonomous Driving

Learning to Change: Choreographing Mixed Traffic Through Lateral Control and Hierarchical Reinforcement Learning

Hierarchical reinforcement learning for self-driving decision-making without reliance on labelled driving data