Abstract:Crack detection at the pixel level across complex scenarios (structural interference and adverse working conditions) is a critical consideration in the maintenance of ballastless track slab (BTS). Although existing deep learning models achieve acceptable accuracy on cracks with a monotonous background, the ground truth with high labor cost is inevitable and their performance in complex scenarios may fall far below their theoretical bounds or even cause “all-black images.” A hybrid algorithm based on synthetic data from digital twin model and weakly supervised style transfer is proposed in this paper for addressing the above challenges. The algorithm uses a region-attention strategy to enable the uncontrolled generative adversarial network (GAN) focusing its attention on weak labels containing crack regions, directly obtaining segmentation results with the same style as the ground truth of the crack forest dataset. In addition, a digital twin model that can simulate the real inspection working conditions is established to generate a synthetic crack dataset, enabling the hybrid algorithm to extract the most discriminative features. The results show that the performance of the hybrid algorithm on inspection images across complex scenarios is nearly 25% higher than that of the DeepLabv3+ network, while the time cost consumed is only 0.5% of the latter. The deployment of the region attention strategy also enables the hybrid algorithm to achieve a mean intersection of union (MIoU) of 79.38%, which is nearly twice as much as that of GAN. It not only eliminates the oversegmentation caused by structures such as rails and fastener systems but also overcomes “all-black images.” In addition, synthetic data can greatly enlarge the range, type, and number of discriminative crack features compared with data augmentation based on limited real data, thus enhancing the performance of the hybrid algorithm for uncertain inspection data. Particularly, the fully trained hybrid algorithm based on the synthetic dataset shows good adaptability and generalization to adverse working conditions such as uneven lighting, noise, and blur.

Empower Parameterized Generative Adversarial Networks Using a Novel Particle Swarm Optimizer: Algorithms and Applications

A New GAN-Based Approach to Data Augmentation and Image Segmentation for Crack Detection in Thermal Imaging Tests

Establishment and Evaluation of Conditional GAN-based Image Dataset for Semantic Segmentation of Structural Cracks

An improved generative adversarial network with modified loss function for crack detection in electromagnetic nondestructive testing

Particle Swarm Optimization for Great Enhancement in Semi-supervised Retinal Vessel Segmentation with Generative Adversarial Networks

CrackGAN: Pavement Crack Detection Using Partially Accurate Ground Truths Based on Generative Adversarial Learning

PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening

Generative adversarial network for optimization of operational parameters based on shield posture requirements

Generative adversarial network: An overview of theory and applications

Physics-guided generative adversarial network for probabilistic structural system identification

Hybrid Pixel-Level Crack Segmentation for Ballastless Track Slab Using Digital Twin Model and Weakly Supervised Style Transfer

A Deeply Supervised Semantic Segmentation Method Based on GAN

Revisiting Generative Adversarial Networks for Binary Semantic Segmentation on Imbalanced Datasets

Melt pool segmentation for additive manufacturing: A generative adversarial network approach

Generative AI-Driven Data Augmentation for Crack Detection in Physical Structures

Research on Data Generation Based on the Combination of Growing-Pruning Gan and Intelligent Parameter Optimization

A pavement crack synthesis method based on conditional generative adversarial networks

Crack Detection Based on Generative Adversarial Networks and Deep Learning

Semantic Segmentation by Improved Generative Adversarial Networks

A Generative adversarial learning strategy for enhanced lightweight crack delineation networks

Survey on Generative Adversarial Behavior in Artificial Neural Tasks