Abstract:Addressing the limitations of current railway track foreign object detection techniques, which suffer from inadequate real-time performance and diminished accuracy in detecting small objects, this paper introduces an innovative vision-based perception methodology harnessing the power of deep learning. Central to this approach is the construction of a railway boundary model utilizing a sophisticated track detection method, along with an enhanced UNet semantic segmentation network to achieve autonomous segmentation of diverse track categories. By employing equal interval division and row-by-row traversal, critical track feature points are precisely extracted, and the track linear equation is derived through the least squares method, thus establishing an accurate railway boundary model. We optimized the YOLOv5s detection model in four aspects: incorporating the SE attention mechanism into the Neck network layer to enhance the model's feature extraction capabilities, adding a prediction layer to improve the detection performance for small objects, proposing a linear size scaling method to obtain suitable anchor boxes, and utilizing Inner-IoU to refine the boundary regression loss function, thereby increasing the positioning accuracy of the bounding boxes. We conducted a detection accuracy validation for railway track foreign object intrusion using a self-constructed image dataset. The results indicate that the proposed semantic segmentation model achieved an MIoU of 91.8%, representing a 3.9% improvement over the previous model, effectively segmenting railway tracks. Additionally, the optimized detection model could effectively detect foreign object intrusions on the tracks, reducing missed and false alarms and achieving a 7.4% increase in the mean average precision (IoU = 0.5) compared to the original YOLOv5s model. The model exhibits strong generalization capabilities in scenarios involving small objects. This proposed approach represents an effective exploration of deep learning techniques for railway track foreign object intrusion detection, suitable for use in complex environments to ensure the operational safety of rail lines.

Deep Learning-Based Railway Foreign Object Intrusion Intelligent Perception Using Attention-Aggregated Semantic Segmentation

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

Unsupervised Deep Learning-Based Point Cloud Detection for Railway Foreign Object Intrusion

Foreign object detection in urban rail transit based on deep differentiation segmentation neural network

Intelligent Railway Foreign Object Detection: A Semi-supervised Convolutional Autoencoder Based Method

Multi-Scale Feature Enhanced Detection of Foreign Object Intrusions on Railways

Railnet: A Segmentation Network For Railroad Detection

Detection of Foreign Matter on High-Speed Train Underbody Based on Deep Learning.

An Efficient Foreign Object Recognition Model in Rail Transit Based on Real-Time Railway Region Extraction and Object Detection

RailEINet:A Novel Scene Segmentation Network for Automatic Train Operation Based on Feature Alignment

Encoder Teacher-student Network for Foreign Object Intrusion

Autonomous Railway Traffic Object Detection Using Feature-Enhanced Single-Shot Detector

Extraction network of forests and lakes along the railway based on remote sensing images

Classification and extraction method of hidden dangers along railway lines based on semantic segmentation network

Semantic Segmentation of Railway Scene Based on Reticulated Multi-scale and Bidirectional Channel Attention

An Illegal Target Intrusion Detection System of Railway Based on Deep Learning and Hough Transform

An Efficient Network for Obstacle Detection in Rail Transit Based on Multi-Task Learning

A Semi-Supervised Railway Foreign Object Detection Method Based on GAN

Automatic Obstacle Detection Method for the Train Based on Deep Learning

RailSeg: Learning Local–Global Feature Aggregation With Contextual Information for Railway Point Cloud Semantic Segmentation

RailSegVITNet: A lightweight VIT-based real-time track surface segmentation network for improving railroad safety