Abstract:Transportation Research Record, Ahead of Print. According to the report to Congress National Strategy to Prevent Trespassing on Railroad Property issued by the Federal Railroad Administration, trespassing is currently the number one cause of all railroad-related deaths. The number of fatalities resulting from trespassing, including both illegally entering and remaining in the railroad right-of-way, is even higher than the number of deaths caused by collisions between vehicles and trains. Accurately and effectively detecting objects at rail crossings is critical for improving railway safety. The convolutional neural network (CNN) is one of the most potent tools in image processing and video surveillance. However, the current CNNs under supervised learning rely on a substantial amount of manually labeled images, which is labor-intensive and time-consuming. This study proposes a weakly supervised learning technique for training foreground-segmentation networks and develops a tailored CNN network, RC-SAFE (railroad crossing surveillance and foreground extraction), to accurately and effectively detect and track both still and moving objects in the railroad crossing area. The weakly supervised learning significantly reduces the load for image labeling. The experimental results on the public CDnet 2014 dataset show that the weakly supervised network outperforms the supervised network and some other state-of-the-art foreground-segmentation methods. Railroad crossing monitoring videos are collected at different railroad crossings to validate the proposed RC-SAFE network. The results confirm the robustness of the proposed RC-SAFE network, and that RC-SAFE can detect any object that does not belong to the railroad crossing, which outperforms object-detection-based models, such as Mask RCNN (a region-based CNN).

ID-Net: an improved mask R-CNN model for intrusion detection under power grid surveillance

Intrusion Detection Algorithm of Power Grid Industrial Control System Based on CNN

Engineering Vehicles Detection Based on Modified Faster R-CNN for Power Grid Surveillance

C-Mobile: A Lightweight Composite MobileNetV2 Model for Intrusive Object Detection under Power Grid Surveillance

ARG-Mask RCNN: An Infrared Insulator Fault-Detection Network Based on Improved Mask RCNN

E-VarifocalNet: A Lightweight Model to Detect Insulators and Their Defects under Power Grid Surveillance.

An Improved Faster R-CNN for Devices Detection in Railway 4C System

PIDNet: an Efficient Network for Dynamic Pedestrian Intrusion Detection

Improved Mask R-CNN for Obstacle Detection of Rail Transit

Detection of Common Foreign Objects on Power Grid Lines Based on Faster R-CNN Algorithm and Data Augmentation Method

Intelligent Video Recognition of Violation Behavior in Substation Site Based on Mask R-CNN

EFM-Net: Feature Extraction and Filtration with Mask Improvement Network for Object Detection in Remote Sensing Images

Obstacle Detection in Dangerous Railway Track Areas by a Convolutional Neural Network

FVCNet: Detection obstacle method based on feature visual clustering network in power line inspection

IMD-Net: Interpretable multi-scale detection network for infrared dim and small objects

A Network Traffic Intrusion Detection Method for Industrial Control Systems Based on Deep Learning

Anti-occlusion multi-object surveillance based on improved deep learning approach and multi-feature enhancement for unmanned smart grid safety

Detection of Defects in Power Grid Inspection Images Based on Multi-scale Fusion

EWNet: An early warning classification framework for smart grid based on local-to-global perception

Improved Mask R-CNN for Aircraft Detection in Remote Sensing Images

Railroad Crossing Surveillance and Foreground Extraction Network: Weakly Supervised Artificial-Intelligence Approach