Abstract:Merge scenarios on highway are often challenging for autonomous driving, due to its lack of sufficient tacit understanding on and subtle interaction with human drivers in the traffic flow. This, as a result, may impose serious safety risks, and often cause traffic jam with autonomous driving. Therefore, human-like autonomous driving becomes important, yet imperative. This paper presents an interaction-aware decision-making and planning method for human-like autonomous driving in merge scenarios. Rather than directly mimicking human behavior, deep inverse reinforcement learning is employed to learn the human-used reward function for decision-making and planning from naturalistic driving data to enhance interpretability and generalizability. To consider the interaction factor, the reward function for planning is utilized to evaluate the joint trajectories of the autonomous driving vehicle (ADV) and traffic vehicles. In contrast to predicting trajectories of traffic vehicles with the fixed trajectory of ADV given by the upstream prediction model, the trajectories of traffic vehicles are predicted by responding to the ADV's behavior in this paper. Additionally, the decision-making module is employed to reduce the solution space of planning via the selection of a proper gap for merging. Both the decision-making and planning algorithms follow a “sampling, evaluation, and selection” framework. After being verified through experiments, the results indicate that the planned trajectories with the presented method are highly similar to those of human drivers. Moreover, compared to the interaction-unaware planning method, the interaction-aware planning method behaves closer to human drivers.

Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios

Rollout-Based Interactive Motion Planning for Automated Vehicles *

Merging Planning in Dense Traffic Scenarios Using Interactive Safe Reinforcement Learning

Behavior and Interaction-aware Motion Planning for Autonomous Driving Vehicles based on Hierarchical Intention and Motion Prediction

Interaction-Aware Behavior Planning for Autonomous Vehicles Validated with Real Traffic Data

A Hybrid Motion Planning Framework for Autonomous Driving in Mixed Traffic Flow

Interaction-Aware Trajectory Prediction and Planning in Dense Highway Traffic using Distributed Model Predictive Control

Integration of Reinforcement Learning Based Behavior Planning With Sampling Based Motion Planning for Automated Driving

Hierarchical Reinforcement Learning for Autonomous Decision Making and Motion Planning of Intelligent Vehicles

Deep Reinforcement Learning for Human-Like Driving Policies in Collision Avoidance Tasks of Self-Driving Cars

Interaction-Aware Planning with Deep Inverse Reinforcement Learning for Human-Like Autonomous Driving in Merge Scenarios

Cooperative Behavior Planning for Automated Driving Using Graph Neural Networks

Hybrid Imitation-Learning Motion Planner for Urban Driving

Integrated Behavior Planning and Motion Control for Autonomous Vehicles with Traffic Rules Compliance

Motion Planning for Autonomous Driving with Real Traffic Data Validation

Collision Avoidance Predictive Motion Planning Based on Integrated Perception and V2V Communication

Risk Assessment and Interactive Motion Planning with Visual Occlusion Using Graph Attention Networks and Reinforcement Learning

Autonomous Vehicles' Turning Motion Planning for Conflict Areas at Mixed-Flow Intersections.

An Interaction-Aware Predictive Motion Planner For Unmanned Ground Vehicles In Dynamic Street Scenarios

An automatic driving trajectory planning approach in complex traffic scenarios based on integrated driver style inference and deep reinforcement learning

iPLAN: Intent-Aware Planning in Heterogeneous Traffic via Distributed Multi-Agent Reinforcement Learning