Abstract:Accurate predictions of future pedestrian trajectory could prevent a considerable number of traffic injuries and improve pedestrian safety. It involves multiple sources of information and real-time interactions, e.g., vehicle speed and ego-motion, pedestrian intention and historical locations. Existing methods directly apply a simple concatenation operation to combine multiple cues while their dynamics over time are less studied. In this paper, we propose a novel Long Short-Term Memory (LSTM), namely, to incorporate multiple sources of information from pedestrians and vehicles adaptively. Different from LSTM, our considers mutual interactions and explores intrinsic relations among multiple cues. First, we introduce extra memory cells to improve the transferability of LSTMs in modeling future variations. These extra memory cells include a speed cell to explicitly model vehicle speed dynamics, an intention cell to dynamically analyze pedestrian crossing intentions and a correlation cell to exploit correlations among temporal frames. These three individual cells uncover the future movement of vehicles, pedestrians and global scenes. Second, we propose a gated shifting operation to learn the movement of pedestrians. The intention of crossing the road or not would significantly affect pedestrian's spatial locations. To this end, global scene dynamics and pedestrian intention information are leveraged to model the spatial shifts. Third, we integrate the speed variations to the output gate and dynamically reweight the output channels via the scaling of vehicle speed. The movement of the vehicle would alter the scale of the predicted pedestrian bounding box: as the vehicle gets closer to the pedestrian, the bounding box is enlarging. Our rescaling process captures the relative movement and updates the size of pedestrian bounding boxes accordingly. Experiments conducted on three pedestrian trajectory forecasting benchmarks show that our a-hieves state-of-the-art performance.

A Hybrid Long Short-Term Memory and Kalman Filter Model for Train Trajectory Prediction

Hybrid Approach Combining Modified Gravity Model and Deep Learning for Short-Term Forecasting of Metro Transit Passenger Flows

Trajectory Forecasting with Neural Networks: an Empirical Evaluation and A New Hybrid Model

A Hybrid LSTM Network for Long-Range Vehicle Trajectory Prediction Based on Adaptive Chirp Mode Decomposition

Predicting Vehicle Trajectory Via Combination of Model-Based and Data-Driven Methods Using Kalman Filter

A Hybrid LSTM-CPS Approach for Long-Term Prediction of Train Delays in Multivariate Time Series

An Enhanced Vehicle Trajectory Prediction Model Leveraging LSTM and Social-Attention Mechanisms

LSTM-based Flight Trajectory Prediction

Vehicle trajectory prediction based on cross-attention and multilevel spatio-temporal features

Hybrid dual Kalman filtering model for short-term traffic flow forecasting

A Hybrid GLM Model for Predicting Citywide Spatio-Temporal Metro Passenger Flow

Vehicle Trajectory Prediction by Knowledge-Driven LSTM Network in Urban Environments

A Hierarchical LSTM-Based Vehicle Trajectory Prediction Method Considering Interaction Information

4-D Flight Trajectory Prediction With Constrained LSTM Network

Modeling Vehicle Interactions via Modified LSTM Models for Trajectory Prediction

Holistic LSTM for Pedestrian Trajectory Prediction

Multi-Aircraft Trajectory Collaborative Prediction Based on Social Long Short-Term Memory Network

An EEMD-EWT-LSTM-based short-term prediction approach for inbound metro ridership

Flight Trajectory Prediction Based on Hybrid- Recurrent Networks

A Hybrid Deep Learning Model for Short-Term Traffic Flow Pre-Diction Considering Spatiotemporal Features

A new hybrid information fusion method for trajectory prediction