Abstract:Crack detection at the pixel level across complex scenarios (structural interference and adverse working conditions) is a critical consideration in the maintenance of ballastless track slab (BTS). Although existing deep learning models achieve acceptable accuracy on cracks with a monotonous background, the ground truth with high labor cost is inevitable and their performance in complex scenarios may fall far below their theoretical bounds or even cause “all-black images.” A hybrid algorithm based on synthetic data from digital twin model and weakly supervised style transfer is proposed in this paper for addressing the above challenges. The algorithm uses a region-attention strategy to enable the uncontrolled generative adversarial network (GAN) focusing its attention on weak labels containing crack regions, directly obtaining segmentation results with the same style as the ground truth of the crack forest dataset. In addition, a digital twin model that can simulate the real inspection working conditions is established to generate a synthetic crack dataset, enabling the hybrid algorithm to extract the most discriminative features. The results show that the performance of the hybrid algorithm on inspection images across complex scenarios is nearly 25% higher than that of the DeepLabv3+ network, while the time cost consumed is only 0.5% of the latter. The deployment of the region attention strategy also enables the hybrid algorithm to achieve a mean intersection of union (MIoU) of 79.38%, which is nearly twice as much as that of GAN. It not only eliminates the oversegmentation caused by structures such as rails and fastener systems but also overcomes “all-black images.” In addition, synthetic data can greatly enlarge the range, type, and number of discriminative crack features compared with data augmentation based on limited real data, thus enhancing the performance of the hybrid algorithm for uncertain inspection data. Particularly, the fully trained hybrid algorithm based on the synthetic dataset shows good adaptability and generalization to adverse working conditions such as uneven lighting, noise, and blur.

Data Augmentation by an Additional Self-Supervised CycleGAN-Based for Shadowed Pavement Detection

Pavement Cracks Coupled With Shadows: A New Shadow-Crack Dataset and A Shadow-Removal-Oriented Crack Detection Approach

Asphalt Pavement Crack Identification Based on Two-Stage Training and Multi-Branch Model Integrating Multiple Attention

A three-stage pavement image crack detection framework with positive sample augmentation

Virtual generation of pavement crack images based on improved deep convolutional generative adversarial network

A pavement crack synthesis method based on conditional generative adversarial networks

Generative AI-Driven Data Augmentation for Crack Detection in Physical Structures

Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG model

A controllable generative model for generating pavement crack images in complex scenes

Establishment and Evaluation of Conditional GAN-based Image Dataset for Semantic Segmentation of Structural Cracks

CrackGAN: Pavement Crack Detection Using Partially Accurate Ground Truths Based on Generative Adversarial Learning

A deeper generative adversarial network for grooved cement concrete pavement crack detection

Automatic Pixel-Level Pavement Crack Recognition Using a Deep Feature Aggregation Segmentation Network with a scSE Attention Mechanism Module

Hybrid Pixel-Level Crack Segmentation for Ballastless Track Slab Using Digital Twin Model and Weakly Supervised Style Transfer

Innovative method for pavement multiple damages segmentation and measurement by the Road-Seg-CapsNet of feature fusion

Two-stage framework with improved U-Net based on self-supervised contrastive learning for pavement crack segmentation

A hybrid deep learning pavement crack semantic segmentation

Automated Pavement Crack Segmentation Using U-Net-based Convolutional Neural Network

SS-GAN based road surface crack region segmentation and forecasting

Two-step deep learning approach for pavement crack damage detection and segmentation

Research on the generation and evaluation of bridge defect datasets for underwater environments utilizing CycleGAN networks