Abstract:Traditional methods of detecting concrete damage, such as manual inspection, are typically slow, labor‐intensive, and subjective. Integrating deep learning algorithms has automated this process, representing a significant advance in building damage inspection. Semantic segmentation, a technique within deep learning, is increasingly recognized for its capability to identify the location and shape of concrete damage accurately. Unlike basic deep learning approaches like classification and object detection, semantic segmentation not only recognizes damage but also delineates its boundaries, and has great potential in facilitating dimension measurement. However, multi‐level, high‐precision detection for various structural damage assessments remains an area requiring further research. This study created a database of reinforced concrete surfaces with pixel‐level, multi‐category semantic segmentation annotations for various levels of component damage, including cracks and spalling of concrete, exposure, buckling, fracture of reinforcing bars, etc. The performance of advanced deep learning segmentation algorithms, including U‐Net, DeepLab, K‐Net, and FastSCNN, was consequently trained and evaluated in detecting various types of concrete damage. All models show good accuracy of more than 98%, but lower F1 scores around 70%. U‐Net and K‐Net demonstrate relatively stable performance, indicating a certain degree of consistency and a high‐performance peak. In contrast, DeepLabv3's F1 score fluctuates significantly, suggesting the model may suffer from overfitting or other stability issues during training, resulting in a relatively low average performance. FastSCNN exhibits the highest potential, achieving the highest F1 score. In addition, this study also tested the performance of each model on new damage images and explored the impact of the dataset proportion ratio (training set vs. validation set), contributing to providing insights into each algorithm's suitability for various inspection scenarios. Finally, perspectives on current challenges and future directions in the field have also been given.

Deep neural networks for automated damage classification in image-based visual data of reinforced concrete structures

Deep Learning-Based Damage Inspection for Concrete Structures

Ultrasonic Array Tomography-Oriented Subsurface Crack Recognition and Cross-Section Image Reconstruction of Reinforced Concrete Structure Using Deep Neural Networks

Automatic Pixel‐level Multiple Damage Detection of Concrete Structure Using Fully Convolutional Network

Automatic damage detection and segmentation using deep learning algorithms in reinforced concrete structure inspections

Automatic Seismic Damage Identification of Reinforced Concrete Columns from Images by a Region-Based Deep Convolutional Neural Network

Convolutional neural networks (CNNs)-based multi-category damage detection and recognition of high-speed rail (HSR) reinforced concrete (RC) bridges using test images

Automated crack detection and crack depth prediction for reinforced concrete structures using deep learning

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

Image-based Reinforced Concrete Component Mechanical Damage Recognition and Structural Safety Rapid Assessment Using Deep Learning with Frequency Information

Continual-learning-based framework for structural damage recognition

Classification of Multistates of Internal Damage in Concrete Based on Convolutional Neural Network Analysis of Time-Frequency Images

Structural damage identification and classification from time-frequency impact echo data using deep learning

Deep learning-based concrete defects classification and detection using semantic segmentation

Structural Damage Detection using Deep Convolutional Neural Network and Transfer Learning

Structural Damage-Causing Concrete Cracking Detection Based on a Deep-Learning Method

Deep Convolutional Neural Network-Based Structural Damage Localization and Quantification Using Transmissibility Data

Deep Learning-Based Concrete Surface Damage Monitoring Method Using Structured Lights and Depth Camera

Engineering deep learning methods on automatic detection of damage in infrastructure due to extreme events

Vision-based Structural Inspection using Multiscale Deep Convolutional Neural Networks

Image-based automatic multiple-damage detection of concrete dams using region-based convolutional neural networks