Abstract:The operation of trains is substantially jeopardized by the presence of railway obstacles. Recent research on vision-based railway obstacle detectors has emphasized using sizeable neural network models to pursue a high accuracy while neglecting power consumption and training costs. To accelerate the model updating, training, and deployment cycle applied in the railway safety guarantee system, this article proposes a lightweight three-stage detection framework to identify obstacles in the single railway image. It is mainly comprised of the coarse region proposal (CRP) module, the lightweight railway obstacle detection network (RODNet), and postprocessing stage. In the CRP module, we set the binarized normed gradient (BING) detector to work on two different scale images for a more effective generation of proposal regions. Then, the intersection-over-minimum (IoM) metric is presented to filter and merge generated subregions. In the RODNet, a more lightweight and effective detection model is designed based on substantial improvements of YOLOv4-tiny, to simultaneously predict bounding boxes on the whole image and in each subregion. The RODNet’s backbone is rebuilt with one-shot aggregation and attention mechanism to reduce parameters and to maintain feature extraction abilities. Moreover, some residual blocks are also integrated into RODNet’s neck and head to improve the detection performance. Finally, a series of operations is devised to fuse, remove, and suppress predicted boxes on the boundary of each candidate subregion to reduce false-positive results at the postprocessing stage. Experimental results in the railway obstacle dataset show that RODNet reduces 48% parameters and 29% floating-point operations per second (FLOPs) with at least a 68.2% improvement of inference speed in the CPU compared with YOLOv4-tiny. Meanwhile, the proposed framework provides 80.3 mean average precision (mAP) at a speed of 65.9 ms/pic in the low-power graphics processing unit (GPU) and achieves a competitive or even better performance compared with the state-of-the-art large detection models.

Real-World Railway Traffic Detection Based on Faster Better Network.

Railway Traffic Object Detection Using Differential Feature Fusion Convolution Neural Network

Accurate and Lightweight RailNet for Real-Time Rail Line Detection

Autonomous Railway Traffic Object Detection Using Feature-Enhanced Single-Shot Detector

An Improved Faster R-CNN for Devices Detection in Railway 4C System

Flexible Neural Network for Fast and Accurate Road Scene Perception.

A Lightweight Framework for Obstacle Detection in the Railway Image Based on Fast Region Proposal and Improved YOLO-Tiny Network

Deep-Learning-Based Detection of Obstacles in Transit on Trams

Application of Lightweight Railway Transit Object Detector

Shunting Mode Railway Obstacles Detection Using Feature Fusion Neural Network

Obstacle detection of rail transit based on deep learning

Railroad Crossing Surveillance and Foreground Extraction Network: Weakly Supervised Artificial-Intelligence Approach

Ultra-Fast Adaptive Track Detection Network

Rail Detection: An Efficient Row-based Network and A New Benchmark

Detection of Component Types and Track Damage for High-Speed Railway Using Region-Based Convolutional Neural Networks

Freight Car Target Detection in a Complex Background Based on Convolutional Neural Networks

Efficient Rail Area Detection Using Convolutional Neural Network

An Effective Railway Intrusion Detection Method Using Dynamic Intrusion Region and Lightweight Neural Network

Automatic Obstacle Detection Method for the Train Based on Deep Learning

Real-time Dense Traffic Detection Using Lightweight Backbone and Improved Path Aggregation Feature Pyramid Network

Research on Railway Track Extraction Method Based on Edge Detection and Attention Mechanism