Abstract:The operation of trains is substantially jeopardized by the presence of railway obstacles. Recent research on vision-based railway obstacle detectors has emphasized using sizeable neural network models to pursue a high accuracy while neglecting power consumption and training costs. To accelerate the model updating, training, and deployment cycle applied in the railway safety guarantee system, this article proposes a lightweight three-stage detection framework to identify obstacles in the single railway image. It is mainly comprised of the coarse region proposal (CRP) module, the lightweight railway obstacle detection network (RODNet), and postprocessing stage. In the CRP module, we set the binarized normed gradient (BING) detector to work on two different scale images for a more effective generation of proposal regions. Then, the intersection-over-minimum (IoM) metric is presented to filter and merge generated subregions. In the RODNet, a more lightweight and effective detection model is designed based on substantial improvements of YOLOv4-tiny, to simultaneously predict bounding boxes on the whole image and in each subregion. The RODNet’s backbone is rebuilt with one-shot aggregation and attention mechanism to reduce parameters and to maintain feature extraction abilities. Moreover, some residual blocks are also integrated into RODNet’s neck and head to improve the detection performance. Finally, a series of operations is devised to fuse, remove, and suppress predicted boxes on the boundary of each candidate subregion to reduce false-positive results at the postprocessing stage. Experimental results in the railway obstacle dataset show that RODNet reduces 48% parameters and 29% floating-point operations per second (FLOPs) with at least a 68.2% improvement of inference speed in the CPU compared with YOLOv4-tiny. Meanwhile, the proposed framework provides 80.3 mean average precision (mAP) at a speed of 65.9 ms/pic in the low-power graphics processing unit (GPU) and achieves a competitive or even better performance compared with the state-of-the-art large detection models.

High-speed rail pole number recognition through deep representation and temporal redundancy

Fast Over-the-Horizon Obstacle Detection Algorithm for Locomotive

RTS-LCSS: A New Method for Real-Time Monitoring of Pantograph Structure

High-speed railway real-time localization auxiliary method based on deep neural network

A Fitting Recognition Approach Combining Depth-Attention YOLOv5 and Prior Synthetic Dataset

Defect Recognition of Insulators on Catenary Via Multi-Oriented Detection and Deep Metric Learning

An Improved Faster R-CNN for Devices Detection in Railway 4C System

ODCS-YOLO detection algorithm for rail surface defects based on Omni-Dimensional Dynamic Convolution and Context Augmentation Module

MFMAN-YOLO: A Method for Detecting Pole-like Obstacles in Complex Environment

Flaw detection of railway catenary insulator based on DP-YOLOv5 algorithm with bright and dark channel enhancement

Urban rail transit obstacle detection based on Improved R-CNN

An Improved Lightweight YOLOv5 Algorithm for Detecting Railway Catenary Hanging String

High-Speed Rail Tunnel Panoramic Inspection Image Recognition Technology Based on Improved YOLOv5

Point cloud segmentation of overhead contact systems with deep learning in high-speed rails

Rail Transit Obstacle Detection Based on Improved CNN

Obstacle detection of rail transit based on deep learning

CNN and Binocular Vision-Based Target Detection and Ranging Framework of Intelligent Railway System

A Lightweight Framework for Obstacle Detection in the Railway Image Based on Fast Region Proposal and Improved YOLO-Tiny Network

An Online Rail Track Fastener Classification System Based on YOLO Models

Automatic railroad track components inspection using real‐time instance segmentation

Distribution Line Pole Detection and Counting Based on YOLO Using UAV Inspection Line Video