Abstract:Predicting and understanding pedestrian intentions is crucial for autonomous vehicles and mobile robots to navigate in a crowd. However, the movement of pedestrian is random. Pedestrian trajectory modeling needs to consider not only the past movement of pedestrians, the interaction between different pedestrians, the constraints of static obstacles in the scene, but also multi-modal of the human trajectory, which brings challenges to pedestrian trajectory prediction. Most of the existing trajectory prediction methods only consider the interaction between pedestrians in the scene, ignoring the static obstacles in the scene can also have impacts on the trajectory of pedestrian. In this paper, a scalable relative interactive spatial-temporal graph generation adversarial network architecture (RISTG-GAN) is proposed to generate a reasonable multi-modal prediction trajectory by considering the interaction effects of all agents in the scene. Our method extends recent work on trajectory prediction. First, LSTM nodes are flexibly used to model the spatial-temporal graph of human-environment interactions, and the spatial-temporal graph is converted into feed-forward differentiable feature coding, and the time attention module is proposed to capture the trajectory information in time domain and learn the time dependence in long time range. Then, we capture the relative importance of the interaction of all agents in the scene on the pedestrian trajectory through the improved relative scaled dot product attention and use the generative adversarial network architecture for training to generate reasonable pedestrian future trajectory distribution. Experiments on five commonly used real public datasets show that RISTG-GAN is better than previous work in terms of reasoning speed, accuracy and the rationality of trajectory prediction.

Multimodal Forward Generation Transformer Network for Inconspicuous Pedestrian Trajectory Prediction

Crossmodal Transformer Based Generative Framework for Pedestrian Trajectory Prediction

Multimodal Transformer Networks for Pedestrian Trajectory Prediction.

Context-aware Pedestrian Trajectory Prediction with Multimodal Transformer

Pedestrian Trajectory Prediction Based on Multimodal Fusion of Motion Sensing Encoder Decoder Network

Social-Transformer: Pedestrian Trajectory Prediction in Autonomous Driving Scenes

Multiple Goals Network for Pedestrian Trajectory Prediction in Autonomous Driving.

Spatio-Temporal Interaction Aware and Trajectory Distribution Aware Graph Convolution Network for Pedestrian Multimodal Trajectory Prediction

A Multi-Stage Goal-Driven Network for Pedestrian Trajectory Prediction

An improved GAN with transformers for pedestrian trajectory prediction models

Anchor-based Multi-modal Transformer Network for Pedestrian Trajectory and Intention Prediction

A Spatio-Temporal Graph Transformer Network for Multi-Pedestrain Trajectory Prediction.

Non-Autoregressive Transformer Based Ego-Motion Independent Pedestrian Trajectory Prediction on Egocentric View

GSGFormer: Generative Social Graph Transformer for Multimodal Pedestrian Trajectory Prediction

A Multimodal Trajectory Prediction Method for Pedestrian Crossing Considering Pedestrian Motion State

Knowledge-aware Graph Transformer for Pedestrian Trajectory Prediction

Multimodal Pedestrian Trajectory Prediction Based on Relative Interactive Spatial-Temporal Graph

GTransPDM: A Graph-embedded Transformer with Positional Decoupling for Pedestrian Crossing Intention Prediction

Multi-Scale Learnable Gabor Transform for Pedestrian Trajectory Prediction from Different Perspectives

A multimodal stepwise-coordinating framework for pedestrian trajectory prediction

Using Appearance to Predict Pedestrian Trajectories Through Disparity-Guided Attention and Convolutional LSTM