Abstract:It is the prerequisite to ensure the safety of road users in traffic scenes for the application of autonomous vehicles. Pedestrians are the main participants in traffic scenes, and reasonable inference and prediction of their future trajectories are crucial for autonomous driving technology and road safety. Pedestrian trajectories are highly dynamic, apparently random, and complex to interact with traffic environment agents; therefore, selective modeling of spatial interaction and temporal dependence of pedestrians is necessary. To address this challenge, this paper proposes a novel pedestrian trajectory prediction model based on a spatio-temporal graph convolutional network (PTP-STGCN). Specifically, a new crowd interaction attention (CIA) function is defined to quantify the interaction information between adjacent pedestrians better. This function captures the spatial interaction features of pedestrians at each time step by a spatial graph convolution network (S-GCN). Meanwhile, the time-series motion features of each pedestrian are extracted by a temporal transformer network (T-transformer), and a spatio-temporal interaction graph of pedestrian features is constructed by the STGCN composed of the S-GCN and T-transformer. Finally, a time-extrapolator convolutional neural network (TXP-CNN) is used to predict pedestrian trajectories in the time dimension of the STGCN. The experimental results on the ETH and UCY datasets show that the proposed model achieves better performance than the state-of-the-art baselines regarding the average displacement error (ADE) and final displacement error (FDE). Due to the excellent performance in pedestrian trajectory prediction, the proposed network achieves more predictive final planned trajectory of an autonomous vehicle, while avoiding unnecessary trajectory changes and collision risk, thus providing a promising solution for practical pedestrian trajectory prediction applications.

Pedestrian Intention Prediction Based on Traffic-Aware Scene Graph Model.

Pedestrian Intention Prediction Via Depth Augmented Scene Restoration

CSGAT-Net: a conditional pedestrian trajectory prediction network based on scene semantic maps and spatiotemporal graph attention

Predicting Pedestrian Crossing Intention with Feature Fusion and Spatio-Temporal Attention

Spatial-Temporal Graph Attention Network for Pedestrian Trajectory Prediction

Pedestrian Graph +: A Fast Pedestrian Crossing Prediction Model Based on Graph Convolutional Networks

PTPGC: Pedestrian trajectory prediction by graph attention network with ConvLSTM

SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Prediction

A Pedestrian Trajectory Prediction Method for Generative Adversarial Networks Based on Scene Constraints

High Efficiency Pedestrian Crossing Prediction

PTP-STGCN: Pedestrian Trajectory Prediction Based on a Spatio-temporal Graph Convolutional Neural Network

Attentional-GCNN: Adaptive Pedestrian Trajectory Prediction towards Generic Autonomous Vehicle Use Cases

Pedestrian Crossing Intention Prediction From Surveillance Videos for Over-the-Horizon Safety Warning

Social-Scene-Aware Generative Adversarial Networks for Pedestrian Trajectory Prediction

Spatio-temporal deep learning framework for pedestrian intention prediction in urban traffic scenes

Spatio-Temporal Interaction Aware and Trajectory Distribution Aware Graph Convolution Network for Pedestrian Multimodal Trajectory Prediction

Using Graph Convolutional Networks Skeleton-Based Pedestrian Intention Estimation Models for Trajectory Prediction

Pedestrian Behavior Prediction Method for Intelligent Vehicles Based on Convolutional Neural Network

Looking Ahead: Anticipating Pedestrians Crossing with Future Frames Prediction

An Attention-Based Interaction-Aware Spatio-Temporal Graph Neural Network for Trajectory Prediction

Static-dynamic Global Graph Representation for Pedestrian Trajectory Prediction