Abstract:Addressing the limitations of current railway track foreign object detection techniques, which suffer from inadequate real-time performance and diminished accuracy in detecting small objects, this paper introduces an innovative vision-based perception methodology harnessing the power of deep learning. Central to this approach is the construction of a railway boundary model utilizing a sophisticated track detection method, along with an enhanced UNet semantic segmentation network to achieve autonomous segmentation of diverse track categories. By employing equal interval division and row-by-row traversal, critical track feature points are precisely extracted, and the track linear equation is derived through the least squares method, thus establishing an accurate railway boundary model. We optimized the YOLOv5s detection model in four aspects: incorporating the SE attention mechanism into the Neck network layer to enhance the model's feature extraction capabilities, adding a prediction layer to improve the detection performance for small objects, proposing a linear size scaling method to obtain suitable anchor boxes, and utilizing Inner-IoU to refine the boundary regression loss function, thereby increasing the positioning accuracy of the bounding boxes. We conducted a detection accuracy validation for railway track foreign object intrusion using a self-constructed image dataset. The results indicate that the proposed semantic segmentation model achieved an MIoU of 91.8%, representing a 3.9% improvement over the previous model, effectively segmenting railway tracks. Additionally, the optimized detection model could effectively detect foreign object intrusions on the tracks, reducing missed and false alarms and achieving a 7.4% increase in the mean average precision (IoU = 0.5) compared to the original YOLOv5s model. The model exhibits strong generalization capabilities in scenarios involving small objects. This proposed approach represents an effective exploration of deep learning techniques for railway track foreign object intrusion detection, suitable for use in complex environments to ensure the operational safety of rail lines.

Foreign object detection for railway ballastless trackbeds: A semisupervised learning method

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

Intelligent Railway Foreign Object Detection: A Semi-supervised Convolutional Autoencoder Based Method

A Semi-Supervised Railway Foreign Object Detection Method Based on GAN

Automatic Rail Surface Defect Inspection Using the Pixelwise Semantic Segmentation Model

A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network

Automated Identification and Localization of Rail Internal Defects Based on Object Detection Networks

Foreign object detection in urban rail transit based on deep differentiation segmentation neural network

Intelligent Detection of Surface Defects in High‐Speed Railway Ballastless Track Based on Self‐Attention and Transfer Learning

Railway track fastener defect detection based on image processing and deep learning techniques: A comparative study

An Anomaly Detection Method for Railway Track Using Semi-supervised Learning and Vision-Lidar Decision Fusion

Hybrid deep learning architecture for rail surface segmentation and surface defect detection

Automatic Rail Surface Defects Inspection Based on Mask R-CNN

Deep Learning for the Detection and Recognition of Rail Defects in Ultrasound B-Scan Images

A railway intrusion detection method based on decomposition and semi-supervised learning for accident protection

Railroad Crossing Surveillance and Foreground Extraction Network: Weakly Supervised Artificial-Intelligence Approach

An Improved Faster R-CNN for Railway Fastening System Detection.

Ballasted Track Behaviour Induced by Absent Sleeper Support and its Detection Based on a Convolutional Neural Network Using Track Data

A Novel Strategy of Two-Stage Cascaded CNN and Overhaul Knowledge Distillation for Fast Railway Foreign Objects Intrusion Detection

Diagnosis of high‐speed railway ballastless track arching based on unsupervised learning framework

Application research of image recognition technology based on improved SVM in abnormal monitoring of rail fasteners