Abstract:Crack detection is vital to maintain the structural safety of in-service bridges, which is an increasing demand in the industrial community. The deep learning-based crack detection is an emerging method that provides a novel way to deal with this problem. Although, the deep neural networks (DNN) can learn to detect cracks themselves, they require large numbers of crack images to learn the features of cracks in the real world. Besides, except for the crack forms, there always exist all kinds of noise motifs that will disturb the correct detection of crack re-gions. The lack of crack sample images has been an obstacle for the improvement of deep learning-based crack detection method. This paper proposes a generative adversarial network (GAN) based method to establish a synthesized crack image dataset with pixel-wise annotations, which provides a novel way aside from the traditional data augmentation method. The Deep Convolutional GAN (DCGAN) model was adopted for the generation of synthesized crack annotations while the Pixel2Pixel model was used to generate the corresponding synthesized crack images. The generated crack annotations and crack images during the training epochs were demonstrated to show how the GANs learn to generate the synthesized images. Moreover, comparative study was conducted to validate the performance of the synthesized crack image dataset for training the crack detection DNN. The results showed the DNN trained by the synthesized images can achieve 74.34% of the MeanIoU that was reached by the same DNN model trained with real images. As for the way of using the synthesized and real crack images for training a crack detection DNN, the way that use the synthesized crack images for pre-training and then use the real images for fine-tuning is better than the way that directly mix the synthesized and real crack images for training. This work provides reference for the GAN-based establishment of crack image dataset and the evaluation of the image quality for training crack detection DNNs.

Metallographic image segmentation of GCr15 bearing steel based on CGAN

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Metallographic Image Augmentation of Heat-resistant Steel Based on Improved DCGAN

Semi-supervised segmentation of metal-artifact contaminated industrial CT images using improved CycleGAN

Microstructure Image Segmentation of 23crni3mo Steel Carburized Layer Based on a Deep Neural Network

A Metal Character Enhancement Method based on Conditional Generative Adversarial Networks

Guided Self-attention: Find the Generalized Necessarily Distinct Vectors for Grain Size Grading

Quantitative Analysis of Metallographic Image Using Attention-Aware Deep Neural Networks

Establishment and Evaluation of Conditional GAN-based Image Dataset for Semantic Segmentation of Structural Cracks

Semantic segmentation of SEM images of lower bainitic and tempered martensitic steels

Research on Intelligent Identification and Grading of Nonmetallic Inclusions in Steels Based on Deep Learning

Assessment of Tool Wear With Insufficient and Unbalanced Data Using Improved Conditional Generative Adversarial Net and High-Quality Optimization Algorithm

GC Snakes: An Efficient and Robust Segmentation Model for Hot Forging Images

Region- and Strength-Controllable GAN for Defect Generation and Segmentation in Industrial Images

A Classification and Segmentation Model for Diamond Abrasive Grains Based on Improved Swin-Unet-SAM

Grain and Grain Boundary Segmentation using Machine Learning with Real and Generated Datasets

Bitewing Radiography Semantic Segmentation Base on Conditional Generative Adversarial Nets

An AttnGAN-Based Macro Image Synthesis Model for Predicting the Internal Structure of Billets

Dual attention deep learning network for automatic steel surface defect segmentation

Reduction of Metal Artefacts in CT with Cycle-GAN

Narrow Gap GTAW Defect Detection and Classification Based on Transfer Learning of Generative Adversarial Networks