Abstract:Pedestrian trajectory prediction in crowd scenes plays a significant role in intelligent transportation systems. The main challenges are manifested in learning motion patterns and addressing future uncertainty. Typically, trajectory prediction is considered in two dimensions, including temporal dynamics modeling and social interactions capturing. For temporal dependencies, although existing models based on recurrent neural networks (RNNs) or convolutional neural networks (CNNs) achieve high performance on short-term prediction, they still suffer from limited scalability for long sequences. For social interactions, previous graph-based methods only consider fixed features but ignore dynamic interactions between pedestrians. Considering that the transformer network has a strong capability of capturing spatial and long-term temporal dynamics, we propose Long-Short Term Spatio-Temporal Aggregation (LSSTA) network for human trajectory prediction. First, a modern variant of graph neural networks, named spatial encoder, is presented to characterize spatial interactions between pedestrians. Second, LSSTA utilizes a transformer network to handle long-term temporal dependencies and aggregates the spatial and temporal features with a temporal convolution network (TCN). Thus, TCN is combined with the transformer to form a long-short term temporal dependency encoder. Additionally, multi-modal prediction is an efficient way to address future uncertainty. Existing auto-encoder modules are extended with static scene information and future ground truth for multi-modal trajectory prediction. Experimental results on complex scenes demonstrate the superior performance of our method in comparison to existing approaches.

Crowd Trajectory Prediction Based on Surveillance Data

Pedestrian Trajectory Prediction Based on Deep Convolutional LSTM Network

Situation-Aware Pedestrian Trajectory Prediction with Spatio-Temporal Attention Model

Conv-LSTM: Pedestrian Trajectory Prediction in Crowded Scenarios.

Social LSTM: Human Trajectory Prediction in Crowded Spaces

Dynamic Pedestrian Trajectory Forecasting with LSTM-based Delaunay Triangulation

CF-LSTM: Cascaded Feature-Based Long Short-Term Networks for Predicting Pedestrian Trajectory

Human Trajectory Prediction in Crowded Scene Using Social-Affinity Long Short-Term Memory

Pedestrian Trajectory Prediction in Crowd Scene Using Deep Neural Networks

Multi-Relational Pedestrian Trajectory Prediction in Complex Scenes.

Human Trajectory Prediction Using Stacked Temporal Convolutional Network

Probability Trajectory: One New Movement Description for Trajectory Prediction

Human Trajectory Prediction for Automatic Guided Vehicle with Recurrent Neural Network

Traffic Agent Trajectory Prediction Using Social Convolution and Attention Mechanism

A Spatio-Temporal 3d Convolutional Neural Network to Predict Pedestriantrajectory in Heterogeneous Traffic

Long-Short Term Spatio-Temporal Aggregation for Trajectory Prediction

Pedestrian Trajectory Prediction with Convolutional Neural Networks

Fast Trajectory Extraction and Pedestrian Dynamics Analysis Using Deep Neural Network

Pedestrian Trajectory Prediction Via the Social-Grid LSTM Model