Abstract:Human-like autonomous driving can enhance user acceptance and integration within traffic. In light of this, this paper presents a planning method for the human-like longitudinal trajectory in car-following scenarios with offline sample-based maximum entropy deep inverse reinforcement learning (DIRL). Specifically, the proposed method doesn’t mimic human driving behavior directly. Instead, it uses naturalistic driving data to learn the internal reward function that leads to these driving behaviors. To enhance the capacity for fitting the human reward function, DIRL leverages deep neural networks to replace linear functions used by traditional IRL. However, the long-tail effect of naturalistic driving data makes it challenging for DIRL to capture the reward function in edge scenarios. A simulated dataset covering edge scenarios is collected by employing feature-based inverse reinforcement learning to deal with this challenge. Furthermore, this paper trains a long-term actor network guided by DIRL’s reward network. The long-term actor network significantly reduces the computation cost by three orders of magnitude compared to the reward network-based method, while also avoiding system oscillation in contrast to the traditional one-step actor network. The simulation experiments confirm that the planning results from the proposed method are closer to human drivers’ behavior than the baseline. And, the hardware-in-the-loop experiment results affirm the proposed method’s effectiveness and good real-time performance. Note to Practitioners —Human-like autonomous driving can enhance user acceptance and integration within traffic. This paper proposes a planning method for human-like car-following driving behaviors using offline sample-based deep inverse reinforcement learning (DIRL). Instead of mimicking human trajectories directly, the method learns the internal reward function leading to these driving behaviors. To address challenges posed by naturalistic driving data’s long-tail effect, a simulated dataset covering edge scenarios is collected by employing feature-based inverse reinforcement learning. Additionally, this paper trains a long-term actor network guided by DIRL’s reward network to reduce the computation cost. The simulation experiments confirm that the planning results from the proposed method are closer to human drivers’ behavior than the baseline. And, the hardware-in-the-loop experiment results affirm the proposed method’s effectiveness and good real-time performance.

LF-Net: A Learning-Based Frenet Planning Approach for Urban Autonomous Driving

PEP: Policy-Embedded Trajectory Planning for Autonomous Driving

Driving-behavior-oriented trajectory planning for autonomous vehicle driving on urban structural road

An End-to-end Deep Reinforcement Learning Approach for the Long-term Short-term Planning on the Frenet Space

Reinforced Imitative Trajectory Planning for Urban Automated Driving

Motion Planner with Fixed-Horizon Constrained Reinforcement Learning for Complex Autonomous Driving Scenarios

Intelligent Vehicle Decision-Making and Trajectory Planning Method Based on Deep Reinforcement Learning in the Frenet Space

Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

A Hybrid Motion Planning Framework for Autonomous Driving in Mixed Traffic Flow

A Long-Term Actor Network for Human-Like Car-Following Trajectory Planning Guided by Offline Sample-Based Deep Inverse Reinforcement Learning

Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving

Closing the Planning-Learning Loop with Application to Autonomous Driving

Reinforcement Learning Based Trajectory Planning for Autonomous Vehicles

Integrating Deep Reinforcement Learning with Model-based Path Planners for Automated Driving

From Naturalistic Traffic Data to Learning-Based Driving Policy: A Sim-to-Real Study

Cooperative Behavior Planning for Automated Driving Using Graph Neural Networks

An automatic driving trajectory planning approach in complex traffic scenarios based on integrated driver style inference and deep reinforcement learning

Online longitudinal trajectory planning for connected and autonomous vehicles in mixed traffic flow with deep reinforcement learning approach

Hybrid Imitation-Learning Motion Planner for Urban Driving

Exploiting Multi-Modal Fusion for Urban Autonomous Driving Using Latent Deep Reinforcement Learning

Enhance Planning with Physics-informed Safety Controller for End-to-end Autonomous Driving