TrajDiffuse: A Conditional Diffusion Model for Environment-Aware Trajectory Prediction

Qingze,Danrui Li,Samuel S. Sohn,Sejong Yoon,Mubbasir Kapadia,Vladimir Pavlovic
2024-10-15
Abstract:Accurate prediction of human or vehicle trajectories with good diversity that captures their stochastic nature is an essential task for many applications. However, many trajectory prediction models produce unreasonable trajectory samples that focus on improving diversity or accuracy while neglecting other key requirements, such as collision avoidance with the surrounding environment. In this work, we propose TrajDiffuse, a planning-based trajectory prediction method using a novel guided conditional diffusion model. We form the trajectory prediction problem as a denoising impaint task and design a map-based guidance term for the diffusion process. TrajDiffuse is able to generate trajectory predictions that match or exceed the accuracy and diversity of the SOTA, while adhering almost perfectly to environmental constraints. We demonstrate the utility of our model through experiments on the nuScenes and PFSD datasets and provide an extensive benchmark analysis against the SOTA methods.
Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to ensure that the generated trajectories meet environmental constraints while guaranteeing prediction accuracy and diversity when predicting human or vehicle trajectories. Although many existing trajectory prediction models can improve diversity and accuracy, they are deficient in generating high - quality trajectory samples that are reasonable and in line with the scene context, especially ignoring the requirement of avoiding collisions with the surrounding environment. This paper proposes a planning - type trajectory prediction method based on the guided conditional diffusion model - TrajDiffuse, aiming to solve these problems. By introducing the map - guiding term, TrajDiffuse can generate trajectory predictions that are both accurate and diverse and almost perfectly abide by environmental constraints. This enables TrajDiffuse to perform excellently in multiple benchmark tests, especially significantly outperforming other existing methods in environmental understanding.