Abstract:The deterioration of infrastructure's health has become more predominant on a global scale during the 21st century. Aging infrastructure as well as those structures damaged by natural disasters have prompted the research community to improve state-of-the-art methodologies for conducting Structural Health Monitoring (SHM). The necessity for efficient SHM arises from the hazards damaged infrastructure imposes, often resulting in structural collapse, leading to economic loss and human fatalities. Furthermore, day-to-day operations in these affected areas are limited until an inspection is performed to assess the level of damage experienced by the structure and the required rehabilitation determined. However, human-based inspections are often labor-intensive, inefficient, subjective, and restricted to accessible site locations, which ultimately negatively impact our ability to collect large amounts of data from inspection sites. Though Deep-Learning (DL) methods have been heavily explored in the past decade to rectify the limitations of traditional methods and automate structural inspection, data scarcity continues to remain prevalent within the field of SHM. The absence of sufficiently large, balanced, and generalized databases to train DL-based models often results in inaccurate and biased damage predictions. Recently, Generative Adversarial Networks (GANs) have received attention from the SHM community as a data augmentation tool by which a training dataset can be expanded to improve the damage classification. However, there are no existing studies within the SHM field which investigate the performance of DL-based multiclass damage identification using synthetic data generated from GANs. Therefore, this paper investigates the performance of a convolutional neural network architecture using synthetic images generated from a GAN for multiclass damage detection of concrete surfaces. Through this study, it was determined the average classification performance of the proposed CNN on hybrid datasets decreased by 10.6% and 7.4% for validation and testing datasets when compared to the same model trained entirely on real samples. Moreover, each model's performance decreased on average by 1.6% when comparing a singular model trained with real samples and the same model trained with both real and synthetic samples for a given training configuration. The correlation between classification accuracy and the amount and diversity of synthetic data used for data augmentation is quantified and the effect of using limited data to train existing GAN architectures is investigated. It was observed that the diversity of the samples decreases and correlation increases with the increase in the number of synthetic samples.

Generative adversarial networks for overlapped and imbalanced problems in impact damage classification

Balanced Semi-Supervised Generative Adversarial Network for Damage Assessment from Low-Data Imbalanced-Class Regime

Data Augmentation Classifier for Imbalanced Fault Classification

Deep Convolutional Generative Adversarial Networks-Based Data Augmentation Method for Classifying Class-Imbalanced Defect Patterns in Wafer Bin Map

Data Augmentation for Deep-Learning-Based Multiclass Structural Damage Detection Using Limited Information

Damage GAN: A Generative Model for Imbalanced Data

Data-augmented Landslide Displacement Prediction Using Generative Adversarial Network

Ensemble Data Augmentation for Imbalanced Fault Diagnosis.

Data Augmentation and Fault Diagnosis for Imbalanced Industrial Process Data Based on Residual Wasserstein Generative Adversarial Network With Gradient Penalty

Efficient Generative Adversarial Networks for Imbalanced Traffic Collision Datasets

Oversampling adversarial network for class-imbalanced fault diagnosis

A new imbalanced data oversampling method based on Bootstrap method and Wasserstein Generative Adversarial Network

A hybrid sampling method for highly imbalanced and overlapped data classification with complex distribution

Image-to-Image Translation-Based Structural Damage Data Augmentation for Infrastructure Inspection Using Unmanned Aerial Vehicle

Over-sampling method for tackling class imbalance in software defect prediction based on generative adversarial networks

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

Generative Adversarial Networks for Labeled Acceleration Data Augmentation for Structural Damage Detection

Crash injury severity prediction considering data imbalance: A Wasserstein generative adversarial network with gradient penalty approach

Revisiting Classical Bagging with Modern Transfer Learning for On-the-fly Disaster Damage Detector

An Imbalanced Data Augmentation and Assessment Method for Industrial Process Fault Classification With Application in Air Compressors

A Novel Method for Imbalanced Fault Diagnosis of Rotating Machinery Based on Generative Adversarial Networks