Abstract:Addressing the limitations of current railway track foreign object detection techniques, which suffer from inadequate real-time performance and diminished accuracy in detecting small objects, this paper introduces an innovative vision-based perception methodology harnessing the power of deep learning. Central to this approach is the construction of a railway boundary model utilizing a sophisticated track detection method, along with an enhanced UNet semantic segmentation network to achieve autonomous segmentation of diverse track categories. By employing equal interval division and row-by-row traversal, critical track feature points are precisely extracted, and the track linear equation is derived through the least squares method, thus establishing an accurate railway boundary model. We optimized the YOLOv5s detection model in four aspects: incorporating the SE attention mechanism into the Neck network layer to enhance the model's feature extraction capabilities, adding a prediction layer to improve the detection performance for small objects, proposing a linear size scaling method to obtain suitable anchor boxes, and utilizing Inner-IoU to refine the boundary regression loss function, thereby increasing the positioning accuracy of the bounding boxes. We conducted a detection accuracy validation for railway track foreign object intrusion using a self-constructed image dataset. The results indicate that the proposed semantic segmentation model achieved an MIoU of 91.8%, representing a 3.9% improvement over the previous model, effectively segmenting railway tracks. Additionally, the optimized detection model could effectively detect foreign object intrusions on the tracks, reducing missed and false alarms and achieving a 7.4% increase in the mean average precision (IoU = 0.5) compared to the original YOLOv5s model. The model exhibits strong generalization capabilities in scenarios involving small objects. This proposed approach represents an effective exploration of deep learning techniques for railway track foreign object intrusion detection, suitable for use in complex environments to ensure the operational safety of rail lines.

Method for Detecting and Tracking Foreign Objects in Substation Videos Based on Embedded AI

Research on Video Detection of Object Intrusion in Substation

Embedded Online Fish Detection and Tracking System Via YOLOv3 and Parallel Correlation Filter

Real-Time Target Detection and Recognition with Deep Convolutional Networks for Intelligent Visual Surveillance

Video Based Head Detection and Tracking Surveillance System

Research on the Method of Foreign Object Detection for Railway Tracks Based on Deep Learning

Real-time Monocular 3D People Localization and Tracking on Embedded System

Target Detection and Recognition for Wide Area Border Defense Intelligent Surveillance.

Object Detection Technology of Substation Patrol Robot Based on Myolo Algorithms

A Novel Object Detection Algorithm in Video

An Efficient Foreign Object Recognition Model in Rail Transit Based on Real-Time Railway Region Extraction and Object Detection

Multi-objective Tracking for Smart Substation Onsite Surveillance Based on YOLO Approach and AKCF

Detection of Large Foreign Objects on Coal Mine Belt Conveyor Based on Improved

Intelligent Railway Foreign Object Detection: A Semi-supervised Convolutional Autoencoder Based Method

Video Image Target Monitoring Based on RNN-LSTM

An Improved Algorithm for Foreign Objects Detection on Power Transmission Lines

Cloud Computing and Visual Attention Based Object Detection for Power Substation Surveillance Robots

A Deep Learning Method to Detect Foreign Objects for Inspecting Power Transmission Lines.

A visual foreign object detection system for wireless charging of electric vehicles

Foreign Objects Identification of Transmission Line Based on Improved YOLOv7

High-speed railway real-time localization auxiliary method based on deep neural network