Abstract:Addressing the limitations of current railway track foreign object detection techniques, which suffer from inadequate real-time performance and diminished accuracy in detecting small objects, this paper introduces an innovative vision-based perception methodology harnessing the power of deep learning. Central to this approach is the construction of a railway boundary model utilizing a sophisticated track detection method, along with an enhanced UNet semantic segmentation network to achieve autonomous segmentation of diverse track categories. By employing equal interval division and row-by-row traversal, critical track feature points are precisely extracted, and the track linear equation is derived through the least squares method, thus establishing an accurate railway boundary model. We optimized the YOLOv5s detection model in four aspects: incorporating the SE attention mechanism into the Neck network layer to enhance the model's feature extraction capabilities, adding a prediction layer to improve the detection performance for small objects, proposing a linear size scaling method to obtain suitable anchor boxes, and utilizing Inner-IoU to refine the boundary regression loss function, thereby increasing the positioning accuracy of the bounding boxes. We conducted a detection accuracy validation for railway track foreign object intrusion using a self-constructed image dataset. The results indicate that the proposed semantic segmentation model achieved an MIoU of 91.8%, representing a 3.9% improvement over the previous model, effectively segmenting railway tracks. Additionally, the optimized detection model could effectively detect foreign object intrusions on the tracks, reducing missed and false alarms and achieving a 7.4% increase in the mean average precision (IoU = 0.5) compared to the original YOLOv5s model. The model exhibits strong generalization capabilities in scenarios involving small objects. This proposed approach represents an effective exploration of deep learning techniques for railway track foreign object intrusion detection, suitable for use in complex environments to ensure the operational safety of rail lines.

Object Detection and Area Perception in Subway Operation Space Based on the Multi-task Model

Post-earthquake Inspection of High-Speed Railway Viaducts with Multi-Scale Task Interaction Deep Learning Strategy

Foreign Object Detection Between PSDs and Metro Doors Using Deep Neural Networks.

Sewer defect instance segmentation, localization, and 3D reconstruction for sewer floating capsule robots

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

Foreign object detection in urban rail transit based on deep differentiation segmentation neural network

Efficient Foreign Object Detection Between PSDs and Metro Doors Via Deep Neural Networks.

Multi-scale object detection for high-speed railway clearance intrusion

Improved Real-Time Joint Object Detection and Road Segmentation Multi-Task Network

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

Subway Obstacle Perception and Identification Method Based on Cloud Edge Collaboration

Research On Target Detection And Feasible Region Segmentation Based On Deep Learning

An Efficient End-to-End Multitask Network Architecture for Defect Inspection

Spatial-Semantic and Temporal Attention Mechanism-Based Online Multi-Object Tracking

Research on multitask model of object detection and road segmentation in unstructured road scenes

One-shot Multi-Object Tracking Using CNN-based Networks with Spatial-Channel Attention Mechanism

Detection of Foreign Objects in Subway Outdoor Platform Based on K-means Algorithm

Boosting Lidar 3D Object Detection with Point Cloud Semantic Segmentation

A loss-balanced multi-task model for simultaneous detection and segmentation

Soft Sensor with Deep Learning for Functional Region Detection in Urban Environments

Multi-level Object Detection by Multi-Sensor Perception of Traffic Scenes