Abstract:Predicting and understanding pedestrian intentions is crucial for autonomous vehicles and mobile robots to navigate in a crowd. However, the movement of pedestrian is random. Pedestrian trajectory modeling needs to consider not only the past movement of pedestrians, the interaction between different pedestrians, the constraints of static obstacles in the scene, but also multi-modal of the human trajectory, which brings challenges to pedestrian trajectory prediction. Most of the existing trajectory prediction methods only consider the interaction between pedestrians in the scene, ignoring the static obstacles in the scene can also have impacts on the trajectory of pedestrian. In this paper, a scalable relative interactive spatial-temporal graph generation adversarial network architecture (RISTG-GAN) is proposed to generate a reasonable multi-modal prediction trajectory by considering the interaction effects of all agents in the scene. Our method extends recent work on trajectory prediction. First, LSTM nodes are flexibly used to model the spatial-temporal graph of human-environment interactions, and the spatial-temporal graph is converted into feed-forward differentiable feature coding, and the time attention module is proposed to capture the trajectory information in time domain and learn the time dependence in long time range. Then, we capture the relative importance of the interaction of all agents in the scene on the pedestrian trajectory through the improved relative scaled dot product attention and use the generative adversarial network architecture for training to generate reasonable pedestrian future trajectory distribution. Experiments on five commonly used real public datasets show that RISTG-GAN is better than previous work in terms of reasoning speed, accuracy and the rationality of trajectory prediction.

Learning to Predict Diverse Trajectory from Human Motion Patterns

A Multimodal Trajectory Prediction Method for Pedestrian Crossing Considering Pedestrian Motion State

Self-paced Learning for Pedestrian Trajectory Prediction.

Crossmodal Transformer Based Generative Framework for Pedestrian Trajectory Prediction

End-to-end Pedestrian Trajectory Prediction Via Efficient Multi-modal Predictors

Pedestrian Trajectory Prediction with Learning-based Approaches: A Comparative Study.

Multi-Relational Pedestrian Trajectory Prediction in Complex Scenes.

Spatio-Temporal Interaction Aware and Trajectory Distribution Aware Graph Convolution Network for Pedestrian Multimodal Trajectory Prediction

MSTCNN: multi-modal spatio-temporal convolutional neural network for pedestrian trajectory prediction

Multimodal Interaction-Aware Trajectory Prediction in Crowded Space

Pedestrian Trajectory Prediction Combining Probabilistic Reasoning and Sequence Learning

Pedestrian Trajectory Prediction Based on Motion Pattern De-Perturbation Strategy

Multimodal Pedestrian Trajectory Prediction Based on Relative Interactive Spatial-Temporal Graph

Stochastic Trajectory Prediction Via Motion Indeterminacy Diffusion

Pedestrian Motion Trajectory Prediction in Intelligent Driving from Far Shot First-Person Perspective Video

Multi-Stream Representation Learning for Pedestrian Trajectory Prediction

Pedestrian Trajectory Prediction Based on Multimodal Fusion of Motion Sensing Encoder Decoder Network

Modeling social interaction and intention for pedestrian trajectory prediction

A Novel Trajectory Generator Based on a Constrained GAN and a Latent Variables Predictor

Complementary Attention Gated Network for Pedestrian Trajectory Prediction

Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction