Abstract:In this paper we propose a deep learning model, which we call step attention, for pedestrian trajectory prediction. The proposed model has a special architecture which consists of recurrent neural networks, convolutional neural networks, and an augmented attention mechanism. Rather than developing architectures to model factors that may affect the walking behavior, the proposed model learns trajectory patterns directly from input sequences. We evaluate the performance of the step attention model using TrajNet–a publicly available benchmark dataset collected from diverse real-world crowded scenarios. We compare the performance of step attention with three existing state-of-the-art algorithms, including social LSTM, social GAN, and occupancy LSTM on the TrajNet benchmark dataset. Our experiments show that the average displacement error (ADE) of step attention for a 4.8-seconds-long prediction horizon is about 0.53 m. The final displacement error (FDE) is 1.72 m. Both average and final displacement errors are favorable compared to the benchmark methods. We conduct a second set of experiments using data collected from a four-way intersection through roadside camera sensor platforms to study the effectiveness of the proposed model in uncrowded environments. On this dataset, the proposed model has an ADE of 0.74 m and a FDE of about 1.40 m for a 6-seconds-long prediction horizon. A complementary set of experiments is conducted to further investigate model performance in a real-world intersection. In these experiments, the model gains an ADE/FDE of 0.76/1.70 m. The proposed model also produces accurate prediction results on different scenarios composed of different walking patterns (e.g., straight and curvy) and different environments (e.g., sidewalk and street). The average displacement errors on all investigated datasets are within the length of a single step of an adult. The experiments also indicate that the displacement error grows almost linearly -ith the prediction horizon.

An LSTM Recurrent Network for Step Counting

Step Counting with Attention-based LSTM

Robust and Accurate Step Counting Based on Motion Mode Recognition for Pedestrian Indoor Positioning Using a Smartphone

Attention-based LSTM Network for Wearable Human Activity Recognition

Self-Adaptive Step Counting on Smartphones under Unrestricted Stepping Modes.

Inferring Activity Patterns from Sparse Step Counts Data with Recurrent Neural Networks

Multi-Activity Step Counting Algorithm Using Deep Learning Foot Flat Detection with an IMU Inside the Sole of a Shoe

LSTM-Based Active User Number Estimation and Prediction for Cellular Systems

Deep stair walking detection using wearable inertial sensor via long short-term memory network

Smartphone-Based Unconstrained Step Detection Fusing a Variable Sliding Window and an Adaptive Threshold

A comparative study of smart insole on real-world step count

Step Attention: Sequential Pedestrian Trajectory Prediction

Pūioio: On-device Real-Time Smartphone-Based Automated Exercise Repetition Counting System

RPNOS: Reliable Pedestrian Navigation on a Smartphone

Intelligent Repetition Counting for Unseen Exercises: A Few-Shot Learning Approach with Sensor Signals

Novel Step Detection Algorithm for Smartphone Indoor Localization Based on CEEMDAN-HT

A Feasible Model Training for LSTM-Based Dual Foot-Mounted Pedestrian INS

Multipath 3D-Conv encoder and temporal-sequence decision for repetitive-action counting

Pedestrian Heading Estimation Based on Spatial Transformer Networks and Hierarchical LSTM

Multimodal Ambulatory Sleep Detection Using LSTM Recurrent Neural Networks

Counting Cells in Time-Lapse Microscopy using Deep Neural Networks