Abstract:Motion forecasting plays a pivotal role in autonomous driving systems, enabling vehicles to execute collision warnings and rational local-path planning based on predictions of the surrounding vehicles. However, prevalent methods often assume complete observed trajectories, neglecting the potential impact of missing values induced by object occlusion, scope limitation, and sensor failures. Such oversights inevitably compromise the accuracy of trajectory predictions. To tackle this challenge, we propose an end-to-end framework, termed Multiscale Transformer (MSTF), meticulously crafted for incomplete trajectory prediction. MSTF integrates a Multiscale Attention Head (MAH) and an Information Increment-based Pattern Adaptive (IIPA) module. Specifically, the MAH component concurrently captures multiscale motion representation of trajectory sequence from various temporal granularities, utilizing a multi-head attention mechanism. This approach facilitates the modeling of global dependencies in motion across different scales, thereby mitigating the adverse effects of missing values. Additionally, the IIPA module adaptively extracts continuity representation of motion across time steps by analyzing missing patterns in the data. The continuity representation delineates motion trend at a higher level, guiding MSTF to generate predictions consistent with motion continuity. We evaluate our proposed MSTF model using two large-scale real-world datasets. Experimental results demonstrate that MSTF surpasses state-of-the-art (SOTA) models in the task of incomplete trajectory prediction, showcasing its efficacy in addressing the challenges posed by missing values in motion forecasting for autonomous driving systems.

Multi-modal trajectory forecasting with Multi-scale Interactions and Multi-pseudo-target Supervision

Hierarchical Vehicle Trajectory Prediction with Interactive Multiple Models

Enhanced Multimodal Trajectory Prediction for Autonomous Vehicles Using Advanced Diffusion Model Techniques

A multi-modal spatial–temporal model for accurate motion forecasting with visual fusion

Sparse Heterogeneous Interactions for Multi-Modal Trajectory Prediction

Multi-Modal Vehicle Trajectory Prediction by Collaborative Learning of Lane Orientation, Vehicle Interaction, and Intention

Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Network

MSTF: Multiscale Transformer for Incomplete Trajectory Prediction

Enhanced Prediction of Multi-Agent Trajectories via Control Inference and State-Space Dynamics

Multi-Vehicle Collaborative Learning for Trajectory Prediction With Spatio-Temporal Tensor Fusion

Multi‐modal Vehicle Trajectory Prediction Based on Mutual Information

Multimodal Trajectory Prediction: A Survey

Path-based Multimodal Trajectories Prediction

Hierarchical Multi-Supervision Multi-Interaction Graph Attention Network for Multi-Camera Pedestrian Trajectory Prediction

Multi-Interaction Trajectory Prediction Method With Serial Attention Patterns for Intelligent Vehicles

Bootstrap Motion Forecasting With Self-Consistent Constraints

A Temporal Multi-Gate Mixture-of-Experts Approach for Vehicle Trajectory and Driving Intention Prediction

A Novel Temporal Multi-Gate Mixture-of-Experts Approach for Vehicle Trajectory and Driving Intention Prediction

Graph-Based Interaction-Aware Multimodal 2D Vehicle Trajectory Prediction using Diffusion Graph Convolutional Networks

3D-Mbnet: Intention Based Multimodal Vehicle Trajectory Prediction with 3D Social Convolution

A multimodal vehicle trajectory prediction method with spatio-temporal feature fusion