Abstract:<p>In the United States, to ensure railroad safety and keep its efficient operation, regular track inspections on track component defects are required by the Federal Railroad Administration (FRA). Various types of inspection equipment are applied, such as ground penetrating radar, laser, and LiDAR, but they are usually very expensive and require extensive training and rich experience to operate. To date, track inspections still rely heavily on manual inspections which are low‐efficiency, subjective, and not as accurate as desired, especially for missing and broken track components, such as spikes, clips, and tie plates. To address this issue, a real‐time pixel‐level rail components detection framework to inspect tracks timely and accurately is proposed in this study. The first public rail components image database, including rails, spikes, and clips, is built and released online. A real‐time pixel‐level detection framework with improved real‐time instance segmentation models is developed. The improved models leverage fast object detection and highly accurate instance segmentation. Backbones with more granular levels and receptive fields are implemented in the proposed models. Compared with the original YOLACT and Mask R‐CNN models, the proposed models are able to: (1) achieve 59.9 bbox mAP, and 63.6 mask mAP with the customized dataset, which are higher than the other models and (2) achieve a real‐time speed which is over 30 FPS processing a high‐resolution video (1,080 × 1,092) with a single GPU. The fast processing speed can quickly turn inspection videos into useful information to assist track maintenance. The railroad track components image dataset can be accessed at <a class="linkBehavior" href="https://github.com/jonguo111/Rail_components_image_data">https://github.com/jonguo111/Rail_components_image_data</a></p>

URS: A Light-Weight Segmentation Model for Train Wheelset Monitoring

RSG-Net: A Recurrent Similarity Network with Ghost Convolution for Wheelset Laser Stripe Image Inpainting

SV-UNet:A Lightweight Fracture Segmentation Model for Logging Images

A Sub-Region Unet for Weak Defects Segmentation with Global Information and Mask-Aware Loss.

A comprehensive laser image dataset for real-time measurement of wheelset geometric parameters

SE-U-Lite: Milling Tool Wear Segmentation Based on Lightweight U-Net Model With Squeeze-and-Excitation Module

Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks

Research on the Recognition Method of the Axle End Mark of a Train Wheelset Based on Machine Vision

Automatic railroad track components inspection using real‐time instance segmentation

Mcnet: Multiple Context Information Segmentation Network Of No-Service Rail Surface Defects

A Novel Online Detection System for Wheelset Size in Railway Transportation.

Latent Space Segmentation Model for Visual Surface Defect Inspection

Advancing Ultrasonic Defect Detection in High-Speed Wheels via UT-YOLO

Online Detection System for Wheel-Set Size of Rail Vehicle Based on 2d Laser Displacement Sensors

ISRM:Introspective Self-supervised Reconstruction Model for Rail Surface Defect Detection and Segmentation

A lightweight efficient semantic segmentation with encoder-decoder for arc interference in robotic arc welding

LiDAR-Assisted UAV Stereo Vision Detection in Railway Freight Transport Measurement

Automatic Rail Surface Defects Inspection Based on Mask R-CNN

Rail Surface Defect Recognition and Classification Method Based on Deep Forest

Research on Automatic Defect Localization for Ultrasonic Normal Probe Detection on Railway Wheel

Laser Curve Extraction of a Train Wheelset Based on an Encoder-Decoder Network.