Abstract:The detection of Rail Surface Defects (RSDs) plays a critical role in railway track maintenance. Traditional image processing methods exhibit limitations due to their intricate design and insufficient robustness, thereby restricting their broader applications. Recently, deep learning-based RSD detection methods have drawn great attention. However, these methods predominantly rely on Convolutional Neural Networks (CNN), neglecting the hierarchical linkages amongst disparate features, which impedes the refined portrayal of RSDs. To address these issues, we propose RailFormer, a novel system leveraging the capabilities of Transformer-based networks for the precise and efficient detection of RSDs. The encoder in RailFormer incorporates overlapped patch merging, efficient self-attention, and a Mix-feed Forward Network (FFN), all meticulously designed to bolster feature fusion from both global and local perspectives. Additionally, we have implemented a Criss-Cross attention module within the decoder to facilitate RSD detection and manage computational complexity. In this study, the proposed RailFormer and four other models including SegFormer, Swin Transformer, ViT, and UNet are trained and compared. We employ the widely used public RSD datasets RSDD, encompassing both Type-I and Type-II RSDD images and a customized RSD dataset, as a basis for performance comparison. The training outcomes and visualization results show that RailFormer achieves the highest mean Intersection over Union (mIoU) and superior visualization performance on the RSDD and the customized RSD datasets. These results demonstrate the superiority of RailFormer and underline its potential for future deployment in railway track inspection applications.

Rail surface defect detection based on improved Mask R-CNN

Automatic Rail Surface Defects Inspection Based on Mask R-CNN

A Rail Surface Defect Detection Method Based on Pyramid Feature and Lightweight Convolutional Neural Network

RSDNet: A New Multiscale Rail Surface Defect Detection Model

Research on deep learning method for rail surface defect detection

Hybrid deep learning architecture for rail surface segmentation and surface defect detection

A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network

MRSDI-CNN: Multi-Model Rail Surface Defect Inspection System Based on Convolutional Neural Networks

Automatic defect detection and segmentation of tunnel surface using modified Mask R-CNN

Rail Surface Defect Detection Using A Transformer-Based Network

Attention Network for Rail Surface Defect Detection Via Consistency of Intersection-over-Union(IoU)-Guided Center-Point Estimation

Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks

High-speed acquisition and intelligent tunnel surface defects recognition

Urban rail transit obstacle detection based on Improved R-CNN

Automatic Rail Surface Defect Inspection Using the Pixelwise Semantic Segmentation Model

MtlrNet: An Effective Deep Multitask Learning Architecture for Rail Crack Detection

Two Deep Learning Networks for Rail Surface Defect Inspection of Limited Samples With Line-Level Label

Region and Edge-Aware Network for Rail Surface Defect Segmentation

FS-RSDD: Few-Shot Rail Surface Defect Detection with Prototype Learning

A Study on Railway Surface Defects Detection Based on Machine Vision

Surface Defects Detection of Paper Dish Based on Mask R-CNN