Abstract:During the operation of the railway system, it is inevitable that there will be track defects that affect train operation safety, especially the defects of the rail and fastener. Therefore, it is necessary to detect these defects in time to ensure the safety of train operations. In recent years, with the development of deep learning and computer vision technology, intelligent detection of track defects has made great progress. However, the existing methods not only suffer from the scarcity of defective samples but also their fine-grained recognition is low due to subtle differences between similar classes; furthermore, their real-time performance also needs to be improved. To solve these problems, this article presents a real-time defect detection method for track components based on instance segmentation. First, an improved lightweight instance segmentation network is proposed for the segmentation and location of fastener and rail. Second, a method that detects fastener defects by analyzing the geometric features of the fastener masks is proposed, which can overcome the scarcity of defective fastener samples. A cascade defect detection network is proposed to realize multiresolution and high-resolution detection of rail, which improves the accuracy of rail defect detection. Finally, the TensorRT inference framework is used to accelerate the defect detection network and realize edge end deployment. The experimental results show that the proposed method can achieve 95.1% recall rate of fastener defects, 98% detection rate of rail defects, and 93.5% classification accuracy of rail defects; 33.4 FPS defect detection speed is implemented in the Jetson AGX Xavier embedded device, which verifies the accuracy and real-time performance of the proposed method.

MtlrNet: An Effective Deep Multitask Learning Architecture for Rail Crack Detection

Post-earthquake Inspection of High-Speed Railway Viaducts with Multi-Scale Task Interaction Deep Learning Strategy

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

Research on deep learning method for rail surface defect detection

A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network

MRSDI-CNN: Multi-Model Rail Surface Defect Inspection System Based on Convolutional Neural Networks

RSDNet: A New Multiscale Rail Surface Defect Detection Model

Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks

CrackNet: A Hybrid Model for Crack Segmentation with Dynamic Loss Function

Automatic Rail Surface Defects Inspection Based on Mask R-CNN

Rail Surface Defect Detection Using A Transformer-Based Network

Enhancing rail safety through real-time defect detection: A novel lightweight network approach

Rail surface defect detection based on improved Mask R-CNN

A Road Crack Segmentation Method Based on Transformer and Multi-Scale Feature Fusion

A Study on Railway Surface Defects Detection Based on Machine Vision

An Automated Instance Segmentation Method for Crack Detection Integrated with CrackMover Data Augmentation

High-speed acquisition and intelligent tunnel surface defects recognition

Pavement Crack Detection and Segmentation Method Based on Improved Deep Learning Fusion Model

Real-Time Defect Detection of Track Components: Considering Class Imbalance and Subtle Difference Between Classes

End-to-end semi-supervised deep learning model for surface crack detection of infrastructures

A Multi-Modal Approach to Rail Surface Condition Analysis: the MFDF-Net