Abstract:Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis tasks, VAE shows the limitation that the generated sample tends to be blurry. We observe that a similar problem, in which the generated trajectory is located between adjacent lanes, often arises in VAE-based trajectory forecasting models. To mitigate this problem, we introduce a hierarchical latent structure into the VAE-based forecasting model. Based on the assumption that the trajectory distribution can be approximated as a mixture of simple distributions (or modes), the low-level latent variable is employed to model each mode of the mixture and the high-level latent variable is employed to represent the weights for the modes. To model each mode accurately, we condition the low-level latent variable using two lane-level context vectors computed in novel ways, one corresponds to vehicle-lane interaction and the other to vehicle-vehicle interaction. The context vectors are also used to model the weights via the proposed mode selection network. To evaluate our forecasting model, we use two large-scale real-world datasets. Experimental results show that our model is not only capable of generating clear multi-modal trajectory distributions but also outperforms the state-of-the-art (SOTA) models in terms of prediction accuracy. Our code is available at https://github.com/d1024choi/HLSTrajForecast.

Variational Autoencoder-Based Vehicle Trajectory Prediction with an Interpretable Latent Space

Autonomous Vehicle Path Prediction Using Conditional Variational Autoencoder Networks

Vehicle Trajectory Prediction Using Intention-based Conditional Variational Autoencoder

Exploring Latent Pathways: Enhancing the Interpretability of Autonomous Driving with a Variational Autoencoder

Expressway Vehicle Trajectory Prediction Based on Fusion Data of Trajectories and Maps from Vehicle Perspective

Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approach

TrajVAE: A Variational AutoEncoder model for trajectory generation

Trajectory Prediction for Human-driven Vehicles Based on a Combined Method of Deep Neural Network and Driving Risk Map

Multi-modal Vehicle Trajectory Prediction Via Attention-based Conditional Variational Autoencoder

Hierarchical Latent Structure for Multi-Modal Vehicle Trajectory Forecasting

Conditional Unscented Autoencoders for Trajectory Prediction

Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Prediction

Conditional Wasserstein Auto-Encoder for Interactive Vehicle Trajectory Prediction

A Hybrid Data-Driven and Mechanism-Based Method for Vehicle Trajectory Prediction

Spatio- Temporal Neural Network with Contrastive Learning for Vehicle Trajectory Prediction

Decision-Oriented Driving Scenario Recognition Based on Unsupervised Learning

VTAE: Variational Transformer Autoencoder with Manifolds Learning

Interactive Generation of Dynamically Feasible Vehicle Trajectories Using Dual-VAE

A Novel Deep Neural Network for Trajectory Prediction in Automated Vehicles Using Velocity Vector Field

Interpretable Goal-Based model for Vehicle Trajectory Prediction in Interactive Scenarios

Multimodal Trajectory Prediction for Diverse Vehicle Types in Autonomous Driving with Heterogeneous Data and Physical Constraints