Abstract:Human-like autonomous driving can enhance user acceptance and integration within traffic. In light of this, this paper presents a planning method for the human-like longitudinal trajectory in car-following scenarios with offline sample-based maximum entropy deep inverse reinforcement learning (DIRL). Specifically, the proposed method doesn’t mimic human driving behavior directly. Instead, it uses naturalistic driving data to learn the internal reward function that leads to these driving behaviors. To enhance the capacity for fitting the human reward function, DIRL leverages deep neural networks to replace linear functions used by traditional IRL. However, the long-tail effect of naturalistic driving data makes it challenging for DIRL to capture the reward function in edge scenarios. A simulated dataset covering edge scenarios is collected by employing feature-based inverse reinforcement learning to deal with this challenge. Furthermore, this paper trains a long-term actor network guided by DIRL’s reward network. The long-term actor network significantly reduces the computation cost by three orders of magnitude compared to the reward network-based method, while also avoiding system oscillation in contrast to the traditional one-step actor network. The simulation experiments confirm that the planning results from the proposed method are closer to human drivers’ behavior than the baseline. And, the hardware-in-the-loop experiment results affirm the proposed method’s effectiveness and good real-time performance. Note to Practitioners —Human-like autonomous driving can enhance user acceptance and integration within traffic. This paper proposes a planning method for human-like car-following driving behaviors using offline sample-based deep inverse reinforcement learning (DIRL). Instead of mimicking human trajectories directly, the method learns the internal reward function leading to these driving behaviors. To address challenges posed by naturalistic driving data’s long-tail effect, a simulated dataset covering edge scenarios is collected by employing feature-based inverse reinforcement learning. Additionally, this paper trains a long-term actor network guided by DIRL’s reward network to reduce the computation cost. The simulation experiments confirm that the planning results from the proposed method are closer to human drivers’ behavior than the baseline. And, the hardware-in-the-loop experiment results affirm the proposed method’s effectiveness and good real-time performance.

Human-like Highway Trajectory Modeling Based on Inverse Reinforcement Learning.

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

A Human-like Trajectory Planning Method by Learning from Naturalistic Driving Data

Learning to Drive Like Human Beings: A Method Based on Deep Reinforcement Learning

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Human-Like Decision Making for Autonomous Vehicles at the Intersection Using Inverse Reinforcement Learning

HGRL: Human-Driving-Data Guided Reinforcement Learning for Autonomous Driving

A Long-Term Actor Network for Human-Like Car-Following Trajectory Planning Guided by Offline Sample-Based Deep Inverse Reinforcement Learning

Learning from Naturalistic Driving Data for Human-like Autonomous Highway Driving

Driving Behavior Modeling Using Naturalistic Human Driving Data With Inverse Reinforcement Learning

ReinforcementDriving: Exploring Trajectories and Navigation for Autonomous Vehicles

Human-Like Autonomous Car-Following Model with Deep Reinforcement Learning

Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving

Inverse Reinforcement Learning Based: Segmented Lane-Change Trajectory Planning with Consideration of Interactive Driving Intention

Learning from Demonstration: Situation-Adaptive Lane Change Trajectory Planning for Automated Highway Driving

Multimodal Vehicular Trajectory Prediction with Inverse Reinforcement Learning and Risk Aversion at Urban Unsignalized Intersections

Hierarchical Learned Risk-Aware Planning Framework for Human Driving Modeling

Reinforcement Learning from Human Feedback for Lane Changing of Autonomous Vehicles in Mixed Traffic

Off-road Autonomous Vehicles Traversability Analysis and Trajectory Planning Based on Deep Inverse Reinforcement Learning

Interaction-Aware Planning with Deep Inverse Reinforcement Learning for Human-Like Autonomous Driving in Merge Scenarios

Human-like Decision Making for Autonomous Lane Changing Using Deep Learning