Abstract:Driving behavior modeling is of great importance for designing safe, smart, and personalized autonomous driving systems. In this paper, an internal reward function-based driving model that emulates the human's decision-making mechanism is utilized. To infer the reward function parameters from naturalistic human driving data, we propose a structural assumption about human driving behavior that focuses on discrete latent driving intentions. It converts the continuous behavior modeling problem to a discrete setting and thus makes maximum entropy inverse reinforcement learning (IRL) tractable to learn reward functions. Specifically, a polynomial trajectory sampler is adopted to generate candidate trajectories considering high-level intentions and approximate the partition function in the maximum entropy IRL framework. An environment model considering interactive behaviors among the ego and surrounding vehicles is built to better estimate the generated trajectories. The proposed method is applied to learn personalized reward functions for individual human drivers from the NGSIM highway driving dataset. The qualitative results demonstrate that the learned reward functions are able to explicitly express the preferences of different drivers and interpret their decisions. The quantitative results reveal that the learned reward functions are robust, which is manifested by only a marginal decline in proximity to the human driving trajectories when applying the reward function in the testing conditions. For the testing performance, the personalized modeling method outperforms the general modeling approach, significantly reducing the modeling errors in human likeness (a custom metric to gauge accuracy), and these two methods deliver better results compared to other baseline methods. Moreover, it is found that predicting the response actions of surrounding vehicles and incorporating their potential decelerations caused by the ego vehicle are critical in estima-ing the generated trajectories, and the accuracy of personalized planning using the learned reward functions relies on the accuracy of the forecasting model.

A Joint Inverse Reinforcement Learning and Deep Learning Model for Drivers' Behavioral Prediction

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

Driving Behavior Modeling Using Naturalistic Human Driving Data With Inverse Reinforcement Learning

Personalized Route Recommendation for Ride-Hailing with Deep Inverse Reinforcement Learning and Real-Time Traffic Conditions

Data-Driven Simulation of Ride-Hailing Services using Imitation and Reinforcement Learning

Driver Intent-Based Intersection Autonomous Driving Collision Avoidance Reinforcement Learning Algorithm

Probabilistic Prediction of Interactive Driving Behavior via Hierarchical Inverse Reinforcement Learning

Predictive Freeway Overtaking Strategy for Automated Vehicles Us-ing Deep Reinforcement Learning

Learning an Interpretable Model for Driver Behavior Prediction with Inductive Biases

From Naturalistic Traffic Data to Learning-Based Driving Policy: A Sim-to-Real Study

Secure Your Ride: Real-time Matching Success Rate Prediction for Passenger-Driver Pairs

A deep inverse reinforcement learning approach to route choice modeling with context-dependent rewards

A Distributed Model-Free Ride-Sharing Approach for Joint Matching, Pricing, and Dispatching using Deep Reinforcement Learning

Adaptive Decision-Making for Autonomous Vehicles: A Learning-Enhanced Game-Theoretic Approach in Interactive Environments

Scalable Deep Reinforcement Learning for Ride-Hailing

Human-Like Autonomous Car-Following Model with Deep Reinforcement Learning

Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving

Uncertainty-aware human-like driving policy learning with deep Bayesian inverse reinforcement learning

SurrealDriver: Designing LLM-powered Generative Driver Agent Framework based on Human Drivers' Driving-thinking Data

Driver Modeling through Deep Reinforcement Learning and Behavioral Game Theory

Supply-Demand-aware Deep Reinforcement Learning for Dynamic Fleet Management