Abstract:Unexpected intrusions by pedestrians at grade crossings pose significant risks to the safety of railroad operations. Currently, there is no information processing system available for monitoring anomalies at grade crossings. Therefore, this paper presents a video processing pipeline and a generative adversarial network (GAN)-based deep learning framework to detect, localize, and analyze abnormal behaviors of pedestrians at grade crossings. First, the motions of pedestrians are represented by temporally-varying trajectories of key points identified by skeleton detection and tracking algorithms. A GAN model is developed to learn both global and local motion features of normal pedestrians only. The abnormal behaviors can then be detected as outliers by a discriminator during the testing phase. In contrast to existing efforts, several measures are taken to further boost model performance, including purposely exploiting overfitting in training to magnify the difference between the normal and the abnormal motion patterns and adding an appropriate amount of noise to enhance model generalization. The experiments conducted on a custom video dataset demonstrate the remarkable performance of our model, which successfully distinguishes motion patterns of squatting and lingering from normal walking. The model achieves a value of 0.89 in the AUC (Area Under the Curve) and notably outperforms the other seven benchmark models. The present method is also able to analyze multiple pedestrians in one video frame with a single run of the GAN model and requires no location-specific information, enabling salient robustness and field-deployability of the model at different locations without retraining.

Abnormal pedestrian crossing detection based on video processing

Representation and Analysis of Pedestrian Crossing States Based on Video Tracking

Multiple Pedestrians Tracking Based on Gaussian Probability Model

Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

A Novel Approach to Design the Fast Pedestrian Detection for Video Surveillance System

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

A Double-Region Learning Algorithm for Counting the Number of Pedestrians in Subway Surveillance Videos

Pedestrian movement trajectory reappearance and crossing feature expression based on video processing

Crosswalk navigation for people with visual impairments on a wearable device.

Towards Accurate Dense Pedestrian Detection Via Occlusion-Prediction Aware Label Assignment and Hierarchical-Nms.

Analysis and Prediction of Pedestrians' Violation Behavior at the Intersection Based on a Markov Chain

Analysis of abnormal pedestrian behaviors at grade crossings based on semi-supervised generative adversarial networks

Real-Time Pedestrian-Vehicle Conflict Detection Algorithm Using Video Data

Pedestrian detection based on modified dynamic background using gaussian mixture models and hog-svm detection

Fast Pedestrian Detection And Tracking Based On Vibe Combined Hog-Svm Scheme

Recognition and Co-Analysis of Pedestrian Activities in Different Parts of Road using Traffic Camera Video

Prediction of Pedestrian Crossing Behavior Based on Surveillance Video

Research on Recognition and Classification of Moving Objects in Mixed Traffic Based on Video Detection

Vision-Based Potential Pedestrian Risk Analysis on Unsignalized Crosswalk Using Data Mining Techniques

Vision-Based Moving Objects Detection with Background Modeling

Cross-Video Pedestrian Tracking Algorithm with a Coordinate Constraint