Abstract:Autonomous driving at unsignalized intersections is still considered a challenging application for machine learning due to the complications associated with handling complex multi-agent scenarios characterized by a high degree of uncertainty. Automating the decision-making process at these safety-critical environments involves comprehending multiple levels of abstractions associated with learning robust driving behaviors to enable the vehicle to navigate efficiently. In this survey, we aim at exploring the state-of-the-art techniques implemented for decision-making applications, with a focus on algorithms that combine Reinforcement Learning (RL) and deep learning for learning traversing policies at unsignalized intersections. The reviewed schemes vary in the proposed driving scenario, in the assumptions made for the used intersection model, in the tackled challenges, and in the learning algorithms that are used. We have presented comparisons for these techniques to highlight their limitations and strengths. Based on our in-depth investigation, it can be discerned that a robust decision-making scheme for navigating real-world unsignalized intersection has yet to be developed. Along with our analysis and discussion, we recommend potential research directions encouraging the interested players to tackle the highlighted challenges. By adhering to our recommendations, decision-making architectures that are both non-overcautious and safe, yet feasible, can be trained and validated in real-world unsignalized intersections environments.

What problem does this paper attempt to address?

The paper primarily explores the technical challenges faced in achieving autonomous driving at unsignalized intersections and focuses on evaluating the application of Reinforcement Learning (RL) based methods in decision-making. Specifically, the paper aims to: 1. **Identify existing technical challenges**: The paper highlights the main difficulties current automated driving systems encounter when navigating unsignalized intersections, including handling complex multi-agent scenarios, making decisions in highly uncertain environments, and learning robust driving behaviors. 2. **Evaluate existing solutions**: It reviews the currently implemented decision-making technologies, particularly those that combine reinforcement learning and deep learning algorithms to learn strategies for crossing unsignalized intersections. These methods differ in the intersection models they assume, the challenges they face, and the learning algorithms they use. 3. **Propose future research directions**: Based on in-depth analysis, it points out the limitations of existing decision-making frameworks and suggests possible research directions to improve the generalization ability of the trained crossing policies in real driving environments. 4. **Focus on specific issues**: Unlike other review literature, this paper specifically focuses on reinforcement learning decision-making techniques for unsignalized intersections, a field that has not yet been comprehensively covered. In summary, this review paper aims to lay the foundation for future research in this field and provide guidance for developing decision-making frameworks that ensure safety without being overly cautious and are feasible. By following the recommendations presented in the paper, such decision-making frameworks can be trained and validated in real unsignalized intersection environments.

Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions

Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections

Safe Efficient Policy Optimization Algorithm for Unsignalized Intersection Navigation

Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning

Application of Hybrid Deep Reinforcement Learning for Managing Connected Cars at Pedestrian Crossings: Challenges and Research Directions

Autonomous Vehicle Decision-Making Framework for Considering Malicious Behavior at Unsignalized Intersections

Uncertainty-Aware Decision-Making for Autonomous Driving at Uncontrolled Intersections

Reinforcement Learning Based Safe Decision Making for Highway Autonomous Driving

Intelligent Autonomous Intersection Management

Autonomous Highway Driving using Deep Reinforcement Learning

AF-DQN: A Large-Scale Decision-Making Method at Unsignalized Intersections with Safe Action Filter and Efficient Exploratory Training Strategy

Courteous Behavior of Automated Vehicles at Unsignalized Intersections Via Reinforcement Learning

Emergency Collision Avoidance Decision-making for Autonomous Vehicles: A Model-based Reinforcement Learning Approach

Deep reinforcement learning for autonomous driving in uncontrolled intersections of Indian roads

Safe and Adaptive Decision Algorithm of Automated Vehicle for Unsignalized Intersection Driving

Reward-Driven Automated Curriculum Learning for Interaction-Aware Self-Driving at Unsignalized Intersections

Autonomous navigation at unsignalized intersections: A coupled reinforcement learning and model predictive control approach

Integrated decision and control at multi-lane intersections with mixed traffic flow

Learn Collision-Free Self-Driving Skills at Urban Intersections with Model-Based Reinforcement Learning

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning