Abstract:Crack detection at the pixel level across complex scenarios (structural interference and adverse working conditions) is a critical consideration in the maintenance of ballastless track slab (BTS). Although existing deep learning models achieve acceptable accuracy on cracks with a monotonous background, the ground truth with high labor cost is inevitable and their performance in complex scenarios may fall far below their theoretical bounds or even cause “all-black images.” A hybrid algorithm based on synthetic data from digital twin model and weakly supervised style transfer is proposed in this paper for addressing the above challenges. The algorithm uses a region-attention strategy to enable the uncontrolled generative adversarial network (GAN) focusing its attention on weak labels containing crack regions, directly obtaining segmentation results with the same style as the ground truth of the crack forest dataset. In addition, a digital twin model that can simulate the real inspection working conditions is established to generate a synthetic crack dataset, enabling the hybrid algorithm to extract the most discriminative features. The results show that the performance of the hybrid algorithm on inspection images across complex scenarios is nearly 25% higher than that of the DeepLabv3+ network, while the time cost consumed is only 0.5% of the latter. The deployment of the region attention strategy also enables the hybrid algorithm to achieve a mean intersection of union (MIoU) of 79.38%, which is nearly twice as much as that of GAN. It not only eliminates the oversegmentation caused by structures such as rails and fastener systems but also overcomes “all-black images.” In addition, synthetic data can greatly enlarge the range, type, and number of discriminative crack features compared with data augmentation based on limited real data, thus enhancing the performance of the hybrid algorithm for uncertain inspection data. Particularly, the fully trained hybrid algorithm based on the synthetic dataset shows good adaptability and generalization to adverse working conditions such as uneven lighting, noise, and blur.

CrackGAN: Pavement Crack Detection Using Partially Accurate Ground Truths Based on Generative Adversarial Learning

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

An active learning method with difficulty learning mechanism for crack detection

Establishment and Evaluation of Conditional GAN-based Image Dataset for Semantic Segmentation of Structural Cracks

A pavement crack synthesis method based on conditional generative adversarial networks

A three-stage pavement image crack detection framework with positive sample augmentation

A deeper generative adversarial network for grooved cement concrete pavement crack detection

Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG model

A controllable generative model for generating pavement crack images in complex scenes

UP-CrackNet: Unsupervised Pixel-Wise Road Crack Detection via Adversarial Image Restoration

Virtual generation of pavement crack images based on improved deep convolutional generative adversarial network

Hybrid Pixel-Level Crack Segmentation for Ballastless Track Slab Using Digital Twin Model and Weakly Supervised Style Transfer

Cracklab: A high-precision and efficient concrete crack segmentation and quantification network

Generative AI-Driven Data Augmentation for Crack Detection in Physical Structures

Robust Semantic Segmentation for Automatic Crack Detection Within Pavement Images Using Multi-Mixing of Global Context and Local Image Features

Crack Detection Based on Generative Adversarial Networks and Deep Learning

Revisiting Generative Adversarial Networks for Binary Semantic Segmentation on Imbalanced Datasets

SS-GAN based road surface crack region segmentation and forecasting

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

A Generative adversarial learning strategy for enhanced lightweight crack delineation networks

Evaluation and Comparison of Deep Learning Methods for Pavement Crack Identification with Visual Images