Abstract:Transportation Research Record, Ahead of Print. According to the report to Congress National Strategy to Prevent Trespassing on Railroad Property issued by the Federal Railroad Administration, trespassing is currently the number one cause of all railroad-related deaths. The number of fatalities resulting from trespassing, including both illegally entering and remaining in the railroad right-of-way, is even higher than the number of deaths caused by collisions between vehicles and trains. Accurately and effectively detecting objects at rail crossings is critical for improving railway safety. The convolutional neural network (CNN) is one of the most potent tools in image processing and video surveillance. However, the current CNNs under supervised learning rely on a substantial amount of manually labeled images, which is labor-intensive and time-consuming. This study proposes a weakly supervised learning technique for training foreground-segmentation networks and develops a tailored CNN network, RC-SAFE (railroad crossing surveillance and foreground extraction), to accurately and effectively detect and track both still and moving objects in the railroad crossing area. The weakly supervised learning significantly reduces the load for image labeling. The experimental results on the public CDnet 2014 dataset show that the weakly supervised network outperforms the supervised network and some other state-of-the-art foreground-segmentation methods. Railroad crossing monitoring videos are collected at different railroad crossings to validate the proposed RC-SAFE network. The results confirm the robustness of the proposed RC-SAFE network, and that RC-SAFE can detect any object that does not belong to the railroad crossing, which outperforms object-detection-based models, such as Mask RCNN (a region-based CNN).

Automated Level Crossing System: A Computer Vision Based Approach with Raspberry Pi Microcontroller

Intelligent Railroad Grade Crossing: Leveraging Semantic Segmentation and Object Detection for Enhanced Safety

Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

Design and development of artificial intelligence assisted railway gate controlling system using internet of things

Machine Learning based Obstacle Detection for Avoiding Accidents on Railway Tracks

Improving Train Track Safety using Drones, Computer Vision and Machine Learning

Automated Detection of Grade-Crossing-trespassing Near Misses Based on Computer Vision Analysis of Surveillance Video Data

Design and Construction of Automatic Railway Crossing Gate Control Using Proximity and Infrared Sensors Based on Omron CP1E E30-SDRA PLC

Design and Implementation of Intelligent Railway System

IoT BASED RAILWAY TRACK MONITORING SYSTEM USING ULTRASONIC SENSOR

Computer Vision Assisted Artificial Intelligence Enabled Smart Traffic Control System for Urban Transportation Management

Visual Monitoring-Based Railway Grade Crossing Surveillance System

Automatic Self Driving Car

Railway Track Specific Traffic Signal Selection Using Deep Learning

Development of surveillance robot based on face recognition using Raspberry-PI and IOT

A Radio Based Intelligent Railway Grade Crossing System to Avoid Collision

Real-Time Traffic Sign Detection and Recognition System using Computer Vision and Machine Learning

Detection of road traffic crashes based on collision estimation

RAILWAY TRACK – CRACK DETECTION SYSTEM BY USING ARDUINO MICROCONTROLLER

Railroad Crossing Surveillance and Foreground Extraction Network: Weakly Supervised Artificial-Intelligence Approach

Recent Advances in Video Analytics for Rail Network Surveillance for Security, Trespass and Suicide Prevention—A Survey