Abstract:The detection of Rail Surface Defects (RSDs) plays a critical role in railway track maintenance. Traditional image processing methods exhibit limitations due to their intricate design and insufficient robustness, thereby restricting their broader applications. Recently, deep learning-based RSD detection methods have drawn great attention. However, these methods predominantly rely on Convolutional Neural Networks (CNN), neglecting the hierarchical linkages amongst disparate features, which impedes the refined portrayal of RSDs. To address these issues, we propose RailFormer, a novel system leveraging the capabilities of Transformer-based networks for the precise and efficient detection of RSDs. The encoder in RailFormer incorporates overlapped patch merging, efficient self-attention, and a Mix-feed Forward Network (FFN), all meticulously designed to bolster feature fusion from both global and local perspectives. Additionally, we have implemented a Criss-Cross attention module within the decoder to facilitate RSD detection and manage computational complexity. In this study, the proposed RailFormer and four other models including SegFormer, Swin Transformer, ViT, and UNet are trained and compared. We employ the widely used public RSD datasets RSDD, encompassing both Type-I and Type-II RSDD images and a customized RSD dataset, as a basis for performance comparison. The training outcomes and visualization results show that RailFormer achieves the highest mean Intersection over Union (mIoU) and superior visualization performance on the RSDD and the customized RSD datasets. These results demonstrate the superiority of RailFormer and underline its potential for future deployment in railway track inspection applications.

Fault diagnosis based on deep learning for current-carrying ring of catenary system in sustainable railway transportation

A deep learning-based approach for fault diagnosis of current-carrying ring in catenary system

An Efficient Approach for Guided Wave Structural Monitoring of Switch Rails Via Deep Convolutional Neural Network-Based Transfer Learning

Defect Recognition of Insulators on Catenary Via Multi-Oriented Detection and Deep Metric Learning

Railway insulator defect detection with deep convolutional neural networks

Catenary insulator defect detection based on contour features and gray similarity matching

Anomaly Detection of High-Speed Railway Catenary Damage

Design of Faster R-CNN-Based Fault Detection Method for Subway Vehicles

Contact Wire Support Defect Detection Using Deep Bayesian Segmentation Neural Networks and Prior Geometric Knowledge

Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning

Multiview Deep Learning Based on Tensor Decomposition and Its Application in Fault Detection of Overhead Contact Systems

Bearing Fault Reconstruction Diagnosis Method Based on ResNet-152 with Multi-Scale Stacked Receptive Field

Fault Diagnosis of High-Speed Railway Turnout Based on Convolutional Neural Network

Grounding Fault Diagnosis of Running Rails Based on a Multi-scale One-Dimensional Convolutional Neural Network in a DC Subway System

Intelligent Diagnosis of Rolling Bearings Fault Based on Multisignal Fusion and MTF-ResNet

A Deep Learning Fault Diagnosis Method for Metro On-Board Detection on Rail Corrugation

Train bearing fault diagnosis based on multi-sensor data fusion and dual-scale residual network

Real-Time Vision-Based System of Fault Detection for Freight Trains

Rail Surface Defect Detection Using A Transformer-Based Network

Railway wagon bearing fault diagnosis method based on improved sparrow search algorithm optimizing variational mode decomposition and multi-level convolutional neural network

Adaptive Deep Learning for High-Speed Railway Catenary Swivel Clevis Defects Detection