Abstract:Human-like autonomous driving can enhance user acceptance and integration within traffic. In light of this, this paper presents a planning method for the human-like longitudinal trajectory in car-following scenarios with offline sample-based maximum entropy deep inverse reinforcement learning (DIRL). Specifically, the proposed method doesn’t mimic human driving behavior directly. Instead, it uses naturalistic driving data to learn the internal reward function that leads to these driving behaviors. To enhance the capacity for fitting the human reward function, DIRL leverages deep neural networks to replace linear functions used by traditional IRL. However, the long-tail effect of naturalistic driving data makes it challenging for DIRL to capture the reward function in edge scenarios. A simulated dataset covering edge scenarios is collected by employing feature-based inverse reinforcement learning to deal with this challenge. Furthermore, this paper trains a long-term actor network guided by DIRL’s reward network. The long-term actor network significantly reduces the computation cost by three orders of magnitude compared to the reward network-based method, while also avoiding system oscillation in contrast to the traditional one-step actor network. The simulation experiments confirm that the planning results from the proposed method are closer to human drivers’ behavior than the baseline. And, the hardware-in-the-loop experiment results affirm the proposed method’s effectiveness and good real-time performance. Note to Practitioners —Human-like autonomous driving can enhance user acceptance and integration within traffic. This paper proposes a planning method for human-like car-following driving behaviors using offline sample-based deep inverse reinforcement learning (DIRL). Instead of mimicking human trajectories directly, the method learns the internal reward function leading to these driving behaviors. To address challenges posed by naturalistic driving data’s long-tail effect, a simulated dataset covering edge scenarios is collected by employing feature-based inverse reinforcement learning. Additionally, this paper trains a long-term actor network guided by DIRL’s reward network to reduce the computation cost. The simulation experiments confirm that the planning results from the proposed method are closer to human drivers’ behavior than the baseline. And, the hardware-in-the-loop experiment results affirm the proposed method’s effectiveness and good real-time performance.

PP-TIL: Personalized Planning for Autonomous Driving with Instance-based Transfer Imitation Learning

PEP: Policy-Embedded Trajectory Planning for Autonomous Driving

Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Driving

Rethinking Imitation-based Planner for Autonomous Driving

LHPF: Look back the History and Plan for the Future in Autonomous Driving

Hybrid Imitation-Learning Motion Planner for Urban Driving

A Personalized Motion Planning Method with Driver Characteristics in Longitudinal and Lateral Directions

A Long-Term Actor Network for Human-Like Car-Following Trajectory Planning Guided by Offline Sample-Based Deep Inverse Reinforcement Learning

Hybrid-Prediction Integrated Planning for Autonomous Driving

End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving

A Study on Learning and Simulating Personalized Car-Following Driving Style

Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safety

Safe and Human‐Like Trajectory Planning of Self‐Driving Cars: A Constraint Imitative Method

Integrating Decision-Making Into Differentiable Optimization Guided Learning for End-to-End Planning of Autonomous Vehicles

PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Driving

A Fast Integrated Planning and Control Framework for Autonomous Driving via Imitation Learning

Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning

PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Driving

Parallel Planning:A New Motion Planning Framework for Autonomous Driving

Towards learning-based planning:The nuPlan benchmark for real-world autonomous driving