Abstract:The operation of trains is substantially jeopardized by the presence of railway obstacles. Recent research on vision-based railway obstacle detectors has emphasized using sizeable neural network models to pursue a high accuracy while neglecting power consumption and training costs. To accelerate the model updating, training, and deployment cycle applied in the railway safety guarantee system, this article proposes a lightweight three-stage detection framework to identify obstacles in the single railway image. It is mainly comprised of the coarse region proposal (CRP) module, the lightweight railway obstacle detection network (RODNet), and postprocessing stage. In the CRP module, we set the binarized normed gradient (BING) detector to work on two different scale images for a more effective generation of proposal regions. Then, the intersection-over-minimum (IoM) metric is presented to filter and merge generated subregions. In the RODNet, a more lightweight and effective detection model is designed based on substantial improvements of YOLOv4-tiny, to simultaneously predict bounding boxes on the whole image and in each subregion. The RODNet’s backbone is rebuilt with one-shot aggregation and attention mechanism to reduce parameters and to maintain feature extraction abilities. Moreover, some residual blocks are also integrated into RODNet’s neck and head to improve the detection performance. Finally, a series of operations is devised to fuse, remove, and suppress predicted boxes on the boundary of each candidate subregion to reduce false-positive results at the postprocessing stage. Experimental results in the railway obstacle dataset show that RODNet reduces 48% parameters and 29% floating-point operations per second (FLOPs) with at least a 68.2% improvement of inference speed in the CPU compared with YOLOv4-tiny. Meanwhile, the proposed framework provides 80.3 mean average precision (mAP) at a speed of 65.9 ms/pic in the low-power graphics processing unit (GPU) and achieves a competitive or even better performance compared with the state-of-the-art large detection models.

Train-to-Edge Cooperative Intelligence for Obstacle Intrusion Detection in Rail Transit

Fast Over-the-Horizon Obstacle Detection Algorithm for Locomotive

Subway Obstacle Perception and Identification Method Based on Cloud Edge Collaboration

Robust Artificial Intelligence-Aided Multimodal Rail-Obstacle Detection Method by Rail Track Topology Reconstruction

Railway obstacle intrusion warning mechanism integrating YOLO-based detection and risk assessment

Local and Global Information in Obstacle Detection on Railway Tracks

Obstacle Detection Method of Underground Electric Locomotive Rail Based on Instance Segmentation

An Illegal Target Intrusion Detection System of Railway Based on Deep Learning and Hough Transform

Obstacle detection of rail transit based on deep learning

Automatic Obstacle Detection Method for the Train Based on Deep Learning

Urban rail transit obstacle detection based on Improved R-CNN

Effective Multi-Stage Training Model For Edge Computing Devices In Intrusion Detection

Application of Lightweight Railway Transit Object Detector

Deep-Learning-Based Detection of Obstacles in Transit on Trams

Research and Application of the Obstacle Avoidance System for High-Speed Railway Tunnel Lining Inspection Train Based on Integrated 3D LiDAR and 2D Camera Machine Vision Technology

A Fast Intrusion Detection Method for High-Speed Railway Clearance Based on Low-Cost Embedded GPUs

Edge-Enabled Real-time Railway Track Segmentation

An Effective Railway Intrusion Detection Method Using Dynamic Intrusion Region and Lightweight Neural Network

Cloud-edge collaboration-based task offloading strategy in railway IoT for intelligent detection

An Improved Faster R-CNN for Devices Detection in Railway 4C System

A Lightweight Framework for Obstacle Detection in the Railway Image Based on Fast Region Proposal and Improved YOLO-Tiny Network