Abstract:Pedestrian trajectory prediction in crowd scenes plays a significant role in intelligent transportation systems. The main challenges are manifested in learning motion patterns and addressing future uncertainty. Typically, trajectory prediction is considered in two dimensions, including temporal dynamics modeling and social interactions capturing. For temporal dependencies, although existing models based on recurrent neural networks (RNNs) or convolutional neural networks (CNNs) achieve high performance on short-term prediction, they still suffer from limited scalability for long sequences. For social interactions, previous graph-based methods only consider fixed features but ignore dynamic interactions between pedestrians. Considering that the transformer network has a strong capability of capturing spatial and long-term temporal dynamics, we propose Long-Short Term Spatio-Temporal Aggregation (LSSTA) network for human trajectory prediction. First, a modern variant of graph neural networks, named spatial encoder, is presented to characterize spatial interactions between pedestrians. Second, LSSTA utilizes a transformer network to handle long-term temporal dependencies and aggregates the spatial and temporal features with a temporal convolution network (TCN). Thus, TCN is combined with the transformer to form a long-short term temporal dependency encoder. Additionally, multi-modal prediction is an efficient way to address future uncertainty. Existing auto-encoder modules are extended with static scene information and future ground truth for multi-modal trajectory prediction. Experimental results on complex scenes demonstrate the superior performance of our method in comparison to existing approaches.

Human Trajectory Prediction in Crowded Scene Using Social-Affinity Long Short-Term Memory

Social LSTM: Human Trajectory Prediction in Crowded Spaces

Multi-Relational Pedestrian Trajectory Prediction in Complex Scenes.

Situation-Aware Pedestrian Trajectory Prediction with Spatio-Temporal Attention Model

Multimodal Interaction-Aware Trajectory Prediction in Crowded Space

Scene-LSTM: A Model for Human Trajectory Prediction

Crowd Trajectory Prediction Based on Surveillance Data

Long-Short Term Spatio-Temporal Aggregation for Trajectory Prediction

CF-LSTM: Cascaded Feature-Based Long Short-Term Networks for Predicting Pedestrian Trajectory

Simultaneous Past and Current Social Interaction-aware Trajectory Prediction for Multiple Intelligent Agents in Dynamic Scenes

Human Trajectory Prediction for Automatic Guided Vehicle with Recurrent Neural Network

SRA-LSTM: Social Relationship Attention LSTM for Human Trajectory Prediction

An Enhanced Vehicle Trajectory Prediction Model Leveraging LSTM and Social-Attention Mechanisms

IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Prediction

SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Prediction

A Spatial-Temporal Attention Model for Human Trajectory Prediction

Trajectory Prediction by Coupling Scene-LSTM with Human Movement LSTM

Human Trajectory Prediction Using Stacked Temporal Convolutional Network

GA-STT: Human Trajectory Prediction with Group Aware Spatial-Temporal Transformer.