Abstract:Addressing the limitations of current railway track foreign object detection techniques, which suffer from inadequate real-time performance and diminished accuracy in detecting small objects, this paper introduces an innovative vision-based perception methodology harnessing the power of deep learning. Central to this approach is the construction of a railway boundary model utilizing a sophisticated track detection method, along with an enhanced UNet semantic segmentation network to achieve autonomous segmentation of diverse track categories. By employing equal interval division and row-by-row traversal, critical track feature points are precisely extracted, and the track linear equation is derived through the least squares method, thus establishing an accurate railway boundary model. We optimized the YOLOv5s detection model in four aspects: incorporating the SE attention mechanism into the Neck network layer to enhance the model's feature extraction capabilities, adding a prediction layer to improve the detection performance for small objects, proposing a linear size scaling method to obtain suitable anchor boxes, and utilizing Inner-IoU to refine the boundary regression loss function, thereby increasing the positioning accuracy of the bounding boxes. We conducted a detection accuracy validation for railway track foreign object intrusion using a self-constructed image dataset. The results indicate that the proposed semantic segmentation model achieved an MIoU of 91.8%, representing a 3.9% improvement over the previous model, effectively segmenting railway tracks. Additionally, the optimized detection model could effectively detect foreign object intrusions on the tracks, reducing missed and false alarms and achieving a 7.4% increase in the mean average precision (IoU = 0.5) compared to the original YOLOv5s model. The model exhibits strong generalization capabilities in scenarios involving small objects. This proposed approach represents an effective exploration of deep learning techniques for railway track foreign object intrusion detection, suitable for use in complex environments to ensure the operational safety of rail lines.

Machine Learning based Obstacle Detection for Avoiding Accidents on Railway Tracks

Improving Train Track Safety using Drones, Computer Vision and Machine Learning

Railway obstacle intrusion warning mechanism integrating YOLO-based detection and risk assessment

Intelligent road segmentation and obstacle detection for autonomous railway vehicle

Detection of Foreign Objects Around the Railway Line with YOLOv8

Intelligent Railroad Grade Crossing: Leveraging Semantic Segmentation and Object Detection for Enhanced Safety

Automatic Obstacle Detection Method for the Train Based on Deep Learning

Local and Global Information in Obstacle Detection on Railway Tracks

An Illegal Target Intrusion Detection System of Railway Based on Deep Learning and Hough Transform

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

Railway Track Specific Traffic Signal Selection Using Deep Learning

Application of Lightweight Railway Transit Object Detector

Deep-Learning-Based Detection of Obstacles in Transit on Trams

Railway obstacle detection and power storage using image processing and hybrid technology

Automated Level Crossing System: A Computer Vision Based Approach with Raspberry Pi Microcontroller

Obstacle detection of rail transit based on deep learning

Deep learning techniques to detect rail indications from ultrasonic data for automated rail monitoring and maintenance

FOD-YOLO NET: Fasteners fault and object detection in railway tracks using deep yolo network1

Robust Artificial Intelligence-Aided Multimodal Rail-Obstacle Detection Method by Rail Track Topology Reconstruction

A Lightweight Framework for Obstacle Detection in the Railway Image Based on Fast Region Proposal and Improved YOLO-Tiny Network

Machine Learning Based Obstacle Detection for Automatic Train Pairing