Abstract:Reinforcement learning-based techniques, empowered by deep-structured neural nets, have demonstrated superiority over rule-based methods in terms of making high-level behavioral decisions due to qualities related to handling large state spaces. Nonetheless, their training time, sample efficiency and the feasibility of the learnt behaviors remain key concerns. In this paper, we propose a novel hierarchical reinforcement learning-based decision-making architecture for learning left-turn policies at unsignalized intersections with feasibility guarantees. The proposed technique is comprised of two layers; a high-level learning-based behavioral planning layer which adopts soft actor-critic (SAC) principles to learn high-level, non-conservative yet safe, driving behaviors, and a low-level motion planning layer that uses Model Predictive Control (MPC) framework to ensure feasibility of the two-dimensional left-turn maneuver. The high-level layer generates reference signals of velocity and yaw angles for the ego vehicle taking into account safety and collision avoidance with the intersection vehicles, whereas the low-level motion planning layer solves an optimization problem to track these reference commands taking into account several vehicle dynamic constraints and ride comfort. While training the behavioral SAC-based planning layer, We develop an adaptive entropy regularization technique that results in faster convergence, higher mean rewards, and lower collision rates. We validate the proposed decision-making scheme in simulated environments and compare with other model free Reinforcement Learning (RL) baselines. The results demonstrate that the proposed integrated framework possesses better training and navigation capabilities.

Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making

Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions

Decision-making at Unsignalized Intersection for Autonomous Vehicles: Left-turn Maneuver with Deep Reinforcement Learning

Towards Safe Decision-Making for Autonomous Vehicles at Unsignalized Intersections

Hierarchical Reinforcement Learning for Self-Driving Decision-Making without Reliance on Labeled Driving Data

Hierarchical reinforcement learning for self-driving decision-making without reliance on labelled driving data

Autonomous Vehicle Decision-Making at Unsignalized Intersection via Deep Reinforcement Learning

Decision-Making Models for Autonomous Vehicles at Unsignalized Intersections Based on Deep Reinforcement Learning.

Reinforcement Learning Based Safe Decision Making for Highway Autonomous Driving

Decision-Making for Autonomous Vehicles in Random Task Scenarios at Unsignalized Intersection Using Deep Reinforcement Learning

Adaptive Decision Making at the Intersection for Autonomous Vehicles Based on Skill Discovery

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections

Autonomous Highway Driving using Deep Reinforcement Learning

Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors

Autonomous navigation at unsignalized intersections: A coupled reinforcement learning and model predictive control approach

Risk-Aware High-level Decisions for Automated Driving at Occluded Intersections with Reinforcement Learning

Deep Reinforcement Learning Based Game-Theoretic Decision-Making for Autonomous Vehicles

Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning

Behavior Planning at Urban Intersections through Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning for Autonomous Decision Making and Motion Planning of Intelligent Vehicles