Abstract:The detection of Rail Surface Defects (RSDs) plays a critical role in railway track maintenance. Traditional image processing methods exhibit limitations due to their intricate design and insufficient robustness, thereby restricting their broader applications. Recently, deep learning-based RSD detection methods have drawn great attention. However, these methods predominantly rely on Convolutional Neural Networks (CNN), neglecting the hierarchical linkages amongst disparate features, which impedes the refined portrayal of RSDs. To address these issues, we propose RailFormer, a novel system leveraging the capabilities of Transformer-based networks for the precise and efficient detection of RSDs. The encoder in RailFormer incorporates overlapped patch merging, efficient self-attention, and a Mix-feed Forward Network (FFN), all meticulously designed to bolster feature fusion from both global and local perspectives. Additionally, we have implemented a Criss-Cross attention module within the decoder to facilitate RSD detection and manage computational complexity. In this study, the proposed RailFormer and four other models including SegFormer, Swin Transformer, ViT, and UNet are trained and compared. We employ the widely used public RSD datasets RSDD, encompassing both Type-I and Type-II RSDD images and a customized RSD dataset, as a basis for performance comparison. The training outcomes and visualization results show that RailFormer achieves the highest mean Intersection over Union (mIoU) and superior visualization performance on the RSDD and the customized RSD datasets. These results demonstrate the superiority of RailFormer and underline its potential for future deployment in railway track inspection applications.

Railway insulator defect detection with deep convolutional neural networks

Defect Recognition of Insulators on Catenary Via Multi-Oriented Detection and Deep Metric Learning

Catenary insulator defect detection based on contour features and gray similarity matching

Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning

An Improved Faster R-CNN for Devices Detection in Railway 4C System

Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks

Deep Learning Approaches on Defect Detection in High Resolution Aerial Images of Insulators

Computer vision–based automatic rod-insulator defect detection in high-speed railway catenary system

A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network

Fault diagnosis based on deep learning for current-carrying ring of catenary system in sustainable railway transportation

Mask R-CNN and multifeature clustering model for catenary insulator recognition and defect detection

Defect Identification Detection Research for Insulator of Transmission Lines Based on Deep Learning

Research on deep learning method for rail surface defect detection

Adversarial Reconstruction Based on Tighter Oriented Localization for Catenary Insulator Defect Detection in High-Speed Railways

Catenary Insulator Defect Detection: A Dataset and an Unsupervised Baseline

An Improved Defect Detection Method for Substation Equipment

Research on defect recognition method of substation inspection images based on faster R-CNN

Image Detection of Insulator Defects Based on Morphological Processing and Deep Learning

Rail Surface Defect Detection Using A Transformer-Based Network

DefGAN: Defect Detection GANs With Latent Space Pitting for High-Speed Railway Insulator

A Decoder-Free Reconstruction Method for Semi-Supervised Surface Defect Detection