Abstract:Predicting the future states of surrounding traffic participants and planning a safe, smooth, and socially compliant trajectory accordingly is crucial for autonomous vehicles. There are two major issues with the current autonomous driving system: the prediction module is often separated from the planning module and the cost function for planning is hard to specify and tune. To tackle these issues, we propose a differentiable integrated prediction-planning framework (DIPP) that can also learn the cost function from data. Specifically, our framework uses a differentiable nonlinear optimizer as the motion planner, which takes as input the predicted trajectories of surrounding agents given by the neural network and optimizes the trajectory for the autonomous vehicle, enabling all operations to be differentiable, including the cost function weights. The proposed framework is trained on a large-scale real-world driving dataset to imitate human driving trajectories in the entire driving scene and validated in both open-loop and closed-loop manners. The open-loop testing results reveal that the proposed method outperforms the baseline methods across a variety of metrics and delivers planning-centric prediction results, allowing the planning module to output trajectories close to those of human drivers. In closed-loop testing, the proposed method outperforms various baseline methods, showing the ability to handle complex urban driving scenarios and robustness against the distributional shift. Importantly, we find that joint training of planning and prediction modules achieves better performance than planning with a separate trained prediction module in both open-loop and closed-loop tests. Moreover, the ablation study indicates that the learnable components in the framework are essential to ensure planning stability and performance.

Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning

Optimization-based Motion Planning for Autonomous Parking Considering Dynamic Obstacle: A Hierarchical Framework

Imitation Learning of Hierarchical Driving Model: from Continuous Intention to Continuous Trajectory

Learning Hierarchical Behavior and Motion Planning for Autonomous Driving.

Hybrid Imitation-Learning Motion Planner for Urban Driving

Behavior and Interaction-aware Motion Planning for Autonomous Driving Vehicles based on Hierarchical Intention and Motion Prediction

Hierarchical Interpretable Imitation Learning for End-to-End Autonomous Driving

QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving

Hierarchical Reinforcement Learning for Autonomous Decision Making and Motion Planning of Intelligent Vehicles

Hierarchical Motion Planning and Tracking for Autonomous Vehicles Using Global Heuristic Based Potential Field and Reinforcement Learning Based Predictive Control

Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving

Motion Planning for Autonomous Vehicles in Uncertain Environments Using Hierarchical Distributional Reinforcement Learning

Motion Planning for Autonomous Driving with Real Traffic Data Validation

Conditional Predictive Behavior Planning with Inverse Reinforcement Learning for Human-like Autonomous Driving

Reinforced Imitative Trajectory Planning for Urban Automated Driving

Differentiable Integrated Motion Prediction and Planning with Learnable Cost Function for Autonomous Driving

Instruct Large Language Models to Drive like Humans

Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning

A Hybrid Motion Planning Framework for Autonomous Driving in Mixed Traffic Flow

Parallel Planning:A New Motion Planning Framework for Autonomous Driving

Hierarchical Motion Planning for Autonomous Driving in Large-Scale Complex Scenarios