Abstract:As technology advances, the use of unmanned aerial vehicles (UAVs) and image sensors for structural monitoring and diagnostics is becoming increasingly critical. This approach enables the efficient inspection and assessment of structural conditions. Furthermore, the integration of deep learning techniques has been proven to be highly effective in detecting damage from structural images, as demonstrated in our study. To enable effective learning by deep learning models, a substantial volume of data is crucial, but collecting appropriate instances of structural damage from real-world scenarios poses challenges and demands specialized knowledge, as well as significant time and resources for labeling. In this study, we propose a methodology that utilizes a generative adversarial network (GAN) for image-to-image translation, with the objective of generating synthetic structural damage data to augment the dataset. Initially, a GAN-based image generation model was trained using paired datasets. When provided with a mask image, this model generated an RGB image based on the annotations. The subsequent step generated domain-specific mask images, a critical task that improved the data augmentation process. These mask images were designed based on prior knowledge to suit the specific characteristics and requirements of the structural damage dataset. These generated masks were then used by the GAN model to produce new RGB image data incorporating various types of damage. In the experimental validation conducted across the three datasets to assess the image generation for data augmentation, our results demonstrated that the generated images closely resembled actual images while effectively conveying information about the newly introduced damage. Furthermore, the experimental validation of damage detection with augmented data entailed a comparative analysis between the performance achieved solely with the original dataset and that attained with the incorporation of additional augmented data. The results for damage detection consistently demonstrated that the utilization of augmented data enhanced performance when compared to relying solely on the original images.

Generative AI-Driven Data Augmentation for Crack Detection in Physical Structures

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

Establishment and Evaluation of Conditional GAN-based Image Dataset for Semantic Segmentation of Structural Cracks

An active learning method with difficulty learning mechanism for crack detection

On Enhancing Crack Semantic Segmentation Using StyleGAN and Brownian Bridge Diffusion

A New GAN-Based Approach to Data Augmentation and Image Segmentation for Crack Detection in Thermal Imaging Tests

Crack Detection Based on Generative Adversarial Networks and Deep Learning

Hybrid Pixel-Level Crack Segmentation for Ballastless Track Slab Using Digital Twin Model and Weakly Supervised Style Transfer

Image-to-Image Translation-Based Structural Damage Data Augmentation for Infrastructure Inspection Using Unmanned Aerial Vehicle

A Generative adversarial learning strategy for enhanced lightweight crack delineation networks

Multi-stage Generative Adversarial Networks for Generating Pavement Crack Images

Expanding Crack Segmentation Dataset with Crack Growth Simulation and Feature Space Diversity

CrackGAN: Pavement Crack Detection Using Partially Accurate Ground Truths Based on Generative Adversarial Learning

A three-stage pavement image crack detection framework with positive sample augmentation

An Automated Instance Segmentation Method for Crack Detection Integrated with CrackMover Data Augmentation

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

Data Augmentation by an Additional Self-Supervised CycleGAN-Based for Shadowed Pavement Detection

Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG model

A Label-Free High Precision Automated Crack Detection Method Based on Unsupervised Generative Attentional Networks and Swin-Crackformer

The Crack Generation Algorithm of Underwater Bridge Based on Improved Generative Adversarial Network

Co-CrackSegment: A New Collaborative Deep Learning Framework for Pixel-Level Semantic Segmentation of Concrete Cracks