Abstract:Crack detection at the pixel level across complex scenarios (structural interference and adverse working conditions) is a critical consideration in the maintenance of ballastless track slab (BTS). Although existing deep learning models achieve acceptable accuracy on cracks with a monotonous background, the ground truth with high labor cost is inevitable and their performance in complex scenarios may fall far below their theoretical bounds or even cause “all-black images.” A hybrid algorithm based on synthetic data from digital twin model and weakly supervised style transfer is proposed in this paper for addressing the above challenges. The algorithm uses a region-attention strategy to enable the uncontrolled generative adversarial network (GAN) focusing its attention on weak labels containing crack regions, directly obtaining segmentation results with the same style as the ground truth of the crack forest dataset. In addition, a digital twin model that can simulate the real inspection working conditions is established to generate a synthetic crack dataset, enabling the hybrid algorithm to extract the most discriminative features. The results show that the performance of the hybrid algorithm on inspection images across complex scenarios is nearly 25% higher than that of the DeepLabv3+ network, while the time cost consumed is only 0.5% of the latter. The deployment of the region attention strategy also enables the hybrid algorithm to achieve a mean intersection of union (MIoU) of 79.38%, which is nearly twice as much as that of GAN. It not only eliminates the oversegmentation caused by structures such as rails and fastener systems but also overcomes “all-black images.” In addition, synthetic data can greatly enlarge the range, type, and number of discriminative crack features compared with data augmentation based on limited real data, thus enhancing the performance of the hybrid algorithm for uncertain inspection data. Particularly, the fully trained hybrid algorithm based on the synthetic dataset shows good adaptability and generalization to adverse working conditions such as uneven lighting, noise, and blur.

Automated Crack Severity Level Detection And Classification For Ballastless Track Slab Using Deep Convolutional Neural Network

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

An Efficient Approach for Guided Wave Structural Monitoring of Switch Rails Via Deep Convolutional Neural Network-Based Transfer Learning

AI-based technology to prognose and diagnose complex crack characteristics of railway concrete sleepers

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

Rail Fatigue Crack Classification by WSCNN-GRU Using Acoustic Emission

A Cascade Broad Neural Network for Concrete Structural Crack Damage Automated Classification

Hybrid Pixel-Level Crack Segmentation for Ballastless Track Slab Using Digital Twin Model and Weakly Supervised Style Transfer

Automatic pixel‐level crack detection with multi‐scale feature fusion for slab tracks

Image-Processing-Based Subway Tunnel Crack Detection System

Automatic Pixel‐Level Crack Detection and Measurement Using Fully Convolutional Network

MtlrNet: An Effective Deep Multitask Learning Architecture for Rail Crack Detection

Acoustic emission wave classification for rail crack monitoring based on synchrosqueezed wavelet transform and multi-branch convolutional neural network

Pavement Fatigue Crack Detection and Severity Classification Based on Convolutional Neural Network

Crack Length Measurement Using Convolutional Neural Networks and Image Processing

Crack Detection of Track Slab Based on RSG-YOLO

Intelligent Detection of Surface Defects in High‐Speed Railway Ballastless Track Based on Self‐Attention and Transfer Learning

A Deep Learning Method for Pavement Crack Identification Based on Limited Field Images

Enhancing Structural Crack Detection through a Multiscale Multilevel Mask Deep Convolutional Neural Network and Line Similarity Index

Automatic Pavement Crack Detection Based on Structured Prediction with the Convolutional Neural Network