Abstract:Accurate predictions of future pedestrian trajectory could prevent a considerable number of traffic injuries and improve pedestrian safety. It involves multiple sources of information and real-time interactions, e.g., vehicle speed and ego-motion, pedestrian intention and historical locations. Existing methods directly apply a simple concatenation operation to combine multiple cues while their dynamics over time are less studied. In this paper, we propose a novel Long Short-Term Memory (LSTM), namely, to incorporate multiple sources of information from pedestrians and vehicles adaptively. Different from LSTM, our considers mutual interactions and explores intrinsic relations among multiple cues. First, we introduce extra memory cells to improve the transferability of LSTMs in modeling future variations. These extra memory cells include a speed cell to explicitly model vehicle speed dynamics, an intention cell to dynamically analyze pedestrian crossing intentions and a correlation cell to exploit correlations among temporal frames. These three individual cells uncover the future movement of vehicles, pedestrians and global scenes. Second, we propose a gated shifting operation to learn the movement of pedestrians. The intention of crossing the road or not would significantly affect pedestrian's spatial locations. To this end, global scene dynamics and pedestrian intention information are leveraged to model the spatial shifts. Third, we integrate the speed variations to the output gate and dynamically reweight the output channels via the scaling of vehicle speed. The movement of the vehicle would alter the scale of the predicted pedestrian bounding box: as the vehicle gets closer to the pedestrian, the bounding box is enlarging. Our rescaling process captures the relative movement and updates the size of pedestrian bounding boxes accordingly. Experiments conducted on three pedestrian trajectory forecasting benchmarks show that our a-hieves state-of-the-art performance.

Pedestrian Trajectory Prediction in Crossing Scenario Using Fuzzy Logic and Switching Kalman Filter

Analysis and Prediction of Pedestrians' Violation Behavior at the Intersection Based on a Markov Chain

Pedestrian movement trajectory reappearance and crossing feature expression based on video processing

Representation and Analysis of Pedestrian Crossing States Based on Video Tracking

Crossmodal Transformer Based Generative Framework for Pedestrian Trajectory Prediction

Crossing-Road Pedestrian Trajectory Prediction Based on Intention and Behavior Identification

Pedestrian Trajectory Prediction Combining Probabilistic Reasoning and Sequence Learning

Bimodal Extended Kalman Filter-Based Pedestrian Trajectory Prediction

Development of pedestrian collision avoidance strategy based on the fusion of Markov and social force models

Pedestrian Trajectory Prediction at Un-Signalized Intersection Using Probabilistic Reasoning and Sequence Learning

Pedestrian Trajectory Prediction Based on Improved Avoidance Force Algorithm

CR-LSTM: Collision-prior Guided Social Refinement for Pedestrian Trajectory Prediction

Identification of pedestrian motion feature in mixed traffic conditions and anti-collision algorithm of autonomous vehicle

A Hierarchical Forecasting Model of Pedestrian Crossing Behavior for Autonomous Vehicle

A pedestrian trajectory prediction method based on improved LSTM network

Path Planning for Intelligent Vehicle Collision Avoidance of Dynamic Pedestrian Using Att-LSTM, MSFM, and MPC at Unsignalized Crosswalk

Holistic LSTM for Pedestrian Trajectory Prediction

Deep learning-based pedestrian trajectory prediction and risk assessment at signalized intersections using trajectory data captured through roadside LiDAR

Situation-Aware Pedestrian Trajectory Prediction with Spatio-Temporal Attention Model

Omni-Mobile Robot Path Planning Based on Pedestrian Trajectory Prediction

Vehicle Path Planning Based on Pedestrian Collision Avoidance Action