Abstract:<p>In the United States, to ensure railroad safety and keep its efficient operation, regular track inspections on track component defects are required by the Federal Railroad Administration (FRA). Various types of inspection equipment are applied, such as ground penetrating radar, laser, and LiDAR, but they are usually very expensive and require extensive training and rich experience to operate. To date, track inspections still rely heavily on manual inspections which are low‐efficiency, subjective, and not as accurate as desired, especially for missing and broken track components, such as spikes, clips, and tie plates. To address this issue, a real‐time pixel‐level rail components detection framework to inspect tracks timely and accurately is proposed in this study. The first public rail components image database, including rails, spikes, and clips, is built and released online. A real‐time pixel‐level detection framework with improved real‐time instance segmentation models is developed. The improved models leverage fast object detection and highly accurate instance segmentation. Backbones with more granular levels and receptive fields are implemented in the proposed models. Compared with the original YOLACT and Mask R‐CNN models, the proposed models are able to: (1) achieve 59.9 bbox mAP, and 63.6 mask mAP with the customized dataset, which are higher than the other models and (2) achieve a real‐time speed which is over 30 FPS processing a high‐resolution video (1,080 × 1,092) with a single GPU. The fast processing speed can quickly turn inspection videos into useful information to assist track maintenance. The railroad track components image dataset can be accessed at <a class="linkBehavior" href="https://github.com/jonguo111/Rail_components_image_data">https://github.com/jonguo111/Rail_components_image_data</a></p>

Railroad missing components detection via cascade region‐based convolutional neural network with predefined proposal templates

Computer Vision-Based Railway Viaduct Component Inspection Using Multi-task Multi-scale Deep Neural Network

Automatic railroad track components inspection using real‐time instance segmentation

Automatic Rail Component Detection Based on AttnConv-Net

Real-Time Defect Detection of Track Components: Considering Class Imbalance and Subtle Difference Between Classes

A subtle defect recognition method for catenary fastener in high-speed railroad using destruction and reconstruction learning

Hybrid deep learning architecture for rail surface segmentation and surface defect detection

Rail Surface Defect Detection Using A Transformer-Based Network

A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network

Railway insulator defect detection with deep convolutional neural networks

Use of deep convolutional neural networks and change detection technology for railway track inspections

Cascade Learning Embedded Vision Inspection of Rail Fastener by Using a Fault Detection IoT Vehicle

High-speed Railway Fastener Detection and Localization Method based on convolutional neural network

An Online Rail Track Fastener Classification System Based on YOLO Models

A Hybrid Deep Learning Based Framework for Component Defect Detection of Moving Trains

MRSDI-CNN: Multi-Model Rail Surface Defect Inspection System Based on Convolutional Neural Networks

RBNet: An Ultra Fast Rendering-based Architecture for Railway Defects Segmentation

Method for Rail Surface Defect Detection Based on Neural Network Architecture Search

Automatic Rail Surface Defects Inspection Based on Mask R-CNN

An effective framework using identification and image reconstruction algorithm for train component defect detection

Research on Railway Track Extraction Method Based on Edge Detection and Attention Mechanism