Abstract:Accurate predictions of future pedestrian trajectory could prevent a considerable number of traffic injuries and improve pedestrian safety. It involves multiple sources of information and real-time interactions, e.g., vehicle speed and ego-motion, pedestrian intention and historical locations. Existing methods directly apply a simple concatenation operation to combine multiple cues while their dynamics over time are less studied. In this paper, we propose a novel Long Short-Term Memory (LSTM), namely, to incorporate multiple sources of information from pedestrians and vehicles adaptively. Different from LSTM, our considers mutual interactions and explores intrinsic relations among multiple cues. First, we introduce extra memory cells to improve the transferability of LSTMs in modeling future variations. These extra memory cells include a speed cell to explicitly model vehicle speed dynamics, an intention cell to dynamically analyze pedestrian crossing intentions and a correlation cell to exploit correlations among temporal frames. These three individual cells uncover the future movement of vehicles, pedestrians and global scenes. Second, we propose a gated shifting operation to learn the movement of pedestrians. The intention of crossing the road or not would significantly affect pedestrian's spatial locations. To this end, global scene dynamics and pedestrian intention information are leveraged to model the spatial shifts. Third, we integrate the speed variations to the output gate and dynamically reweight the output channels via the scaling of vehicle speed. The movement of the vehicle would alter the scale of the predicted pedestrian bounding box: as the vehicle gets closer to the pedestrian, the bounding box is enlarging. Our rescaling process captures the relative movement and updates the size of pedestrian bounding boxes accordingly. Experiments conducted on three pedestrian trajectory forecasting benchmarks show that our a-hieves state-of-the-art performance.

Representing Multimodal Behaviors With Mean Location for Pedestrian Trajectory Prediction

End-to-end Pedestrian Trajectory Prediction Via Efficient Multi-modal Predictors

Map-Adaptive Multimodal Trajectory Prediction via Intention-Aware Unimodal Trajectory Predictors

Crossmodal Transformer Based Generative Framework for Pedestrian Trajectory Prediction

Modeling interpretable social interactions for pedestrian trajectory

Spatio-Temporal Interaction Aware and Trajectory Distribution Aware Graph Convolution Network for Pedestrian Multimodal Trajectory Prediction

Enhanced Multimodal Trajectory Prediction for Autonomous Vehicles Using Advanced Diffusion Model Techniques

Conditional Variational Inference for Multi-modal Trajectory Prediction with Latent Diffusion Prior.

Multimodal Pedestrian Trajectory Prediction using Probabilistic Proposal Network

3D-Mbnet: Intention Based Multimodal Vehicle Trajectory Prediction with 3D Social Convolution

Learning to Predict Diverse Trajectory from Human Motion Patterns

Multimodal Pedestrian Trajectory Prediction Based on Relative Interactive Spatial-Temporal Graph

A multimodal stepwise-coordinating framework for pedestrian trajectory prediction

Modality Exploration, Retrieval and Adaptation for Trajectory Prediction.

Pedestrian Trajectory Prediction Based on Motion Pattern De-Perturbation Strategy

Path-based Multimodal Trajectories Prediction

MSTCNN: multi-modal spatio-temporal convolutional neural network for pedestrian trajectory prediction

Modeling social interaction and intention for pedestrian trajectory prediction

Multi-PPTP: Multiple Probabilistic Pedestrian Trajectory Prediction in the Complex Junction Scene

Holistic LSTM for Pedestrian Trajectory Prediction