Abstract:Driving behavior modeling is of great importance for designing safe, smart, and personalized autonomous driving systems. In this paper, an internal reward function-based driving model that emulates the human's decision-making mechanism is utilized. To infer the reward function parameters from naturalistic human driving data, we propose a structural assumption about human driving behavior that focuses on discrete latent driving intentions. It converts the continuous behavior modeling problem to a discrete setting and thus makes maximum entropy inverse reinforcement learning (IRL) tractable to learn reward functions. Specifically, a polynomial trajectory sampler is adopted to generate candidate trajectories considering high-level intentions and approximate the partition function in the maximum entropy IRL framework. An environment model considering interactive behaviors among the ego and surrounding vehicles is built to better estimate the generated trajectories. The proposed method is applied to learn personalized reward functions for individual human drivers from the NGSIM highway driving dataset. The qualitative results demonstrate that the learned reward functions are able to explicitly express the preferences of different drivers and interpret their decisions. The quantitative results reveal that the learned reward functions are robust, which is manifested by only a marginal decline in proximity to the human driving trajectories when applying the reward function in the testing conditions. For the testing performance, the personalized modeling method outperforms the general modeling approach, significantly reducing the modeling errors in human likeness (a custom metric to gauge accuracy), and these two methods deliver better results compared to other baseline methods. Moreover, it is found that predicting the response actions of surrounding vehicles and incorporating their potential decelerations caused by the ego vehicle are critical in estima-ing the generated trajectories, and the accuracy of personalized planning using the learned reward functions relies on the accuracy of the forecasting model.

Hierarchical Learned Risk-Aware Planning Framework for Human Driving Modeling

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

A Multimodal Data-Driven Approach for Driving Risk Assessment

Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving

A Learning-Based Model Predictive Trajectory Planning Controller for Automated Driving in Unstructured Dynamic Environments

Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

Driver's Individual Risk Perception-Based Trajectory Planning: A Human-Like Method

Trajectory Prediction for Human-driven Vehicles Based on a Combined Method of Deep Neural Network and Driving Risk Map

Learning from Naturalistic Driving Data for Human-like Autonomous Highway Driving

An Integrating Comprehensive Trajectory Prediction with Risk Potential Field Method for Autonomous Driving

Towards Safe Motion Planning for Autonomous Driving in Highway

Research on Anthropomorphic Obstacle Avoidance Trajectory Planning for Adaptive Driving Scenarios Based on Inverse Reinforcement Learning Theory

Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning

Behavior and Interaction-aware Motion Planning for Autonomous Driving Vehicles based on Hierarchical Intention and Motion Prediction

A Hybrid Motion Planning Framework for Autonomous Driving in Mixed Traffic Flow

Planning by Simulation: Motion Planning with Learning-based Parallel Scenario Prediction for Autonomous Driving

An automatic driving trajectory planning approach in complex traffic scenarios based on integrated driver style inference and deep reinforcement learning

Hybrid Imitation-Learning Motion Planner for Urban Driving

Human-like Highway Trajectory Modeling Based on Inverse Reinforcement Learning.

Driving Behavior Modeling Using Naturalistic Human Driving Data With Inverse Reinforcement Learning