Abstract:Driving behavior modeling is of great importance for designing safe, smart, and personalized autonomous driving systems. In this paper, an internal reward function-based driving model that emulates the human's decision-making mechanism is utilized. To infer the reward function parameters from naturalistic human driving data, we propose a structural assumption about human driving behavior that focuses on discrete latent driving intentions. It converts the continuous behavior modeling problem to a discrete setting and thus makes maximum entropy inverse reinforcement learning (IRL) tractable to learn reward functions. Specifically, a polynomial trajectory sampler is adopted to generate candidate trajectories considering high-level intentions and approximate the partition function in the maximum entropy IRL framework. An environment model considering interactive behaviors among the ego and surrounding vehicles is built to better estimate the generated trajectories. The proposed method is applied to learn personalized reward functions for individual human drivers from the NGSIM highway driving dataset. The qualitative results demonstrate that the learned reward functions are able to explicitly express the preferences of different drivers and interpret their decisions. The quantitative results reveal that the learned reward functions are robust, which is manifested by only a marginal decline in proximity to the human driving trajectories when applying the reward function in the testing conditions. For the testing performance, the personalized modeling method outperforms the general modeling approach, significantly reducing the modeling errors in human likeness (a custom metric to gauge accuracy), and these two methods deliver better results compared to other baseline methods. Moreover, it is found that predicting the response actions of surrounding vehicles and incorporating their potential decelerations caused by the ego vehicle are critical in estima-ing the generated trajectories, and the accuracy of personalized planning using the learned reward functions relies on the accuracy of the forecasting model.

A Maximum Entropy Inverse Reinforcement Learning Algorithm for Automatic Parking

Reinforcement Learning-Based End-to-End Parking for Automatic Parking System

An Automatic Parking Model Based on Deep Reinforcement Learning

Reinforcement Learning-Based Algorithm for Real-Time Automated Parking Decision Making.

Data Efficient Reinforcement Learning for Integrated Lateral Planning and Control in Automated Parking System

Maximum Entropy Inverse Reinforcement Learning Using Monte Carlo Tree Search for Autonomous Driving

Design of a reinforcement learning-based intelligent car transfer planning system for parking lots.

Model-Based Predictive Control and Reinforcement Learning for Planning Vehicle-Parking Trajectories for Vertical Parking Spaces

Efficient Sampling-Based Maximum Entropy Inverse Reinforcement Learning with Application to Autonomous Driving

Deep reinforcement learning-based drift parking control of automated vehicles

Speeding Up Path Planning via Reinforcement Learning in MCTS for Automated Parking

Inverse Reinforcement Learning with Multiple Ranked Experts

Time-Optimal Maneuver Planning in Automatic Parallel Parking Using a Simultaneous Dynamic Optimization Approach

Real-time Allocation of Shared Parking Spaces Based on Deep Reinforcement Learning

Multi-objective Longitudinal Decision-making for Autonomous Electric Vehicle: A Entropy-constrained Reinforcement Learning Approach.

Random Prior Network for Autonomous Driving Decision-Making Based on Reinforcement Learning

Driving Behavior Modeling Using Naturalistic Human Driving Data With Inverse Reinforcement Learning

Autonomous Drifting Based on Maximal Safety Probability Learning

Multi-Agent Car Parking using Reinforcement Learning

ParkingE2E: Camera-based End-to-end Parking Network, from Images to Planning

Master General Parking Skill Via Deep Learning