Abstract:Pedestrian trajectory prediction is a key technology in many real applications such as video surveillance, social robot navigation, and autonomous driving, and significant progress has been made in this research topic. However, there remain two limitations of previous studies. First, the losses of the last time steps are heavier weighted than that of the beginning time steps in the objective function at the learning stage, causing the prediction errors generated at the beginning to accumulate to large errors at the last time steps at the inference stage. Second, the prediction results of multiple pedestrians in the prediction horizon might be socially incompatible with the interactions modeled by past trajectories. To overcome these limitations, this work proposes a novel trajectory prediction method called CSR, which consists of a cascaded conditional variational autoencoder (CVAE) module and a socially-aware regression module. The CVAE module estimates the future trajectories in a cascaded sequential manner. Specifically, each CVAE concatenates the past trajectories and the predicted location points so far as the input and predicts the adjacent location at the following time step. The socially-aware regression module generates offsets from the estimated future trajectories to produce the corrected predictions, which are more reasonable and accurate than the estimated trajectories. Experiments results demonstrate that the proposed method exhibits significant improvements over state-of-the-art methods on the Stanford Drone Dataset (SDD) and the ETH/UCY dataset of approximately 38.0% and 22.2%, respectively. The code is available at https://github.com/zhouhao94/CSR.

Pedestrian Trajectory Prediction Using a Social Pyramid

Socially-Informed Reconstruction for Pedestrian Trajectory Forecasting

Social-Transformer: Pedestrian Trajectory Prediction in Autonomous Driving Scenes

Scene Gated Social Graph: Pedestrian Trajectory Prediction Based on Dynamic Social Graphs and Scene Constraints

Multi-Relational Pedestrian Trajectory Prediction in Complex Scenes.

Learning Sparse Interaction Graphs of Partially Detected Pedestrians for Trajectory Prediction

Situation-Aware Pedestrian Trajectory Prediction with Spatio-Temporal Attention Model

Action-Aware Encoder-Decoder Network for Pedestrian Trajectory Prediction

Modeling social interaction and intention for pedestrian trajectory prediction

Crossing-Road Pedestrian Trajectory Prediction Via Encoder-Decoder LSTM.

CF-LSTM: Cascaded Feature-Based Long Short-Term Networks for Predicting Pedestrian Trajectory

Pedestrian Trajectory Prediction Combining Probabilistic Reasoning and Sequence Learning

A Unified Environmental Network for Pedestrian Trajectory Prediction

Stochastic trajectory prediction with social graph network

Pedestrian Motion Prediction Using Transformer-based Behavior Clustering and Data-Driven Reachability Analysis

Spatio-Temporal Interaction Aware and Trajectory Distribution Aware Graph Convolution Network for Pedestrian Multimodal Trajectory Prediction

Egocentric Two-Frame Pedestrian Trajectory Prediction Algorithm Based on a Panoramic Camera

Pedestrian Trajectory Prediction in Heterogeneous Traffic Using Pose Keypoints-Based Convolutional Encoder-Decoder Network

SocialVAE: Human Trajectory Prediction using Timewise Latents

SRA-LSTM: Social Relationship Attention LSTM for Human Trajectory Prediction

CSR: Cascade Conditional Variational AutoEncoder with Social-aware Regression for Pedestrian Trajectory Prediction