Abstract:Accurate predictions of future pedestrian trajectory could prevent a considerable number of traffic injuries and improve pedestrian safety. It involves multiple sources of information and real-time interactions, e.g., vehicle speed and ego-motion, pedestrian intention and historical locations. Existing methods directly apply a simple concatenation operation to combine multiple cues while their dynamics over time are less studied. In this paper, we propose a novel Long Short-Term Memory (LSTM), namely, to incorporate multiple sources of information from pedestrians and vehicles adaptively. Different from LSTM, our considers mutual interactions and explores intrinsic relations among multiple cues. First, we introduce extra memory cells to improve the transferability of LSTMs in modeling future variations. These extra memory cells include a speed cell to explicitly model vehicle speed dynamics, an intention cell to dynamically analyze pedestrian crossing intentions and a correlation cell to exploit correlations among temporal frames. These three individual cells uncover the future movement of vehicles, pedestrians and global scenes. Second, we propose a gated shifting operation to learn the movement of pedestrians. The intention of crossing the road or not would significantly affect pedestrian's spatial locations. To this end, global scene dynamics and pedestrian intention information are leveraged to model the spatial shifts. Third, we integrate the speed variations to the output gate and dynamically reweight the output channels via the scaling of vehicle speed. The movement of the vehicle would alter the scale of the predicted pedestrian bounding box: as the vehicle gets closer to the pedestrian, the bounding box is enlarging. Our rescaling process captures the relative movement and updates the size of pedestrian bounding boxes accordingly. Experiments conducted on three pedestrian trajectory forecasting benchmarks show that our a-hieves state-of-the-art performance.

Early Intention Prediction of Pedestrians Using Contextual Attention-Based LSTM

Context Model for Pedestrian Intention Prediction using Factored Latent-Dynamic Conditional Random Fields

Predicting Pedestrian Crossing Intention with Feature Fusion and Spatio-Temporal Attention

Using Appearance to Predict Pedestrian Trajectories Through Disparity-Guided Attention and Convolutional LSTM

Pedestrian Trajectory Prediction for Autonomous Vehicle by Integrating IA-LSTM and MSFM

Pedestrian Intention Prediction Based on Traffic-Aware Scene Graph Model.

CR-LSTM: Collision-prior Guided Social Refinement for Pedestrian Trajectory Prediction

Understanding Pedestrian-Vehicle Interactions with Vehicle Mounted Vision: An LSTM Model and Empirical Analysis

Trajectory Tracking and Prediction of Pedestrian's Crossing Intention Using Roadside LiDAR

High Efficiency Pedestrian Crossing Prediction

Fully Convolutional Encoder-Decoder With an Attention Mechanism for Practical Pedestrian Trajectory Prediction

Holistic LSTM for Pedestrian Trajectory Prediction

Real-time Intent Prediction of Pedestrians for Autonomous Ground Vehicles via Spatio-Temporal DenseNet

Pedestrian Intention Prediction Via Depth Augmented Scene Restoration

Coupling Intent and Action for Pedestrian Crossing Behavior Prediction

Pedestrian Crossing Intention Prediction From Surveillance Videos for Over-the-Horizon Safety Warning

A pedestrian trajectory prediction method based on improved LSTM network

A low complexity contextual stacked ensemble-learning approach for pedestrian intent prediction

Local and Global Contextual Features Fusion for Pedestrian Intention Prediction

Pedestrian Crossing Intention Prediction Based on Cross-Modal Transformer and Uncertainty-Aware Multi-Task Learning for Autonomous Driving

Social Aware Multi-modal Pedestrian Crossing Behavior Prediction.