Abstract:Although computer vision and image processing techniques have been introduced to perform pixel-level damage detection from images, the existed studies mainly investigated cracks. However, concrete spalling and rebar corrosion regions are always irregular and lathy. Effective recognition models of these damage types still lack, especially in the real-world situations with complicated background disturbances. This study proposed a novel pixel-level damage detection method for concrete spalling and rebar corrosion based on U-net semantic segmentation. The proposed U-net architecture consists of three encoder and decoder stages, which are connected by a bridge section. A series of convolutional, batch normalization and ReLU layers are arranged in sequence, and max pooling, dropout, transposed convolutional and depth concatenation layers are specifically designed. A weighted pixel segmentation layer is designed to solve the unbalanced data problem. The total number of original images is 1763 and their dimensions are 512 x 512 x 3. 85% of images are used for training, 10% for validation, and the rest 5% for test. Data augmentation including random rotation, flipping, shearing, translation, and scaling is adopted in the training process. The final training accuracy reaches 85.85% after all the 1350 training iterations of 50 epochs. The average recognition precision and recall for background, concrete spalling and rebar corrosion are0.7662 and 0.7697, respectively. The global accuracy, mean accuracy, mean IoU, weighted IoU reaches 0.7815, 0.7697, 0.3747, and 0.7251, respectively. The category-wise IoU of background, concrete spalling and rebar corrosion regions reaches 0.7842, 0.2629, and 0.0770, respectively. It shows the rebar corrosion has the lowest IoU and mean F1 score, which may be caused by the incomplete and inaccurate pixel ground-truth labels. From the randomly selected test results, it can be found that new damage regions are correctly classified even though they are not appropriately labeled before training. Results shows that the proposed U-net segmentation model can achieve good recognition performance for the irregular concrete spalling and rebar corrosion regions. Some recognition misjudgments are actually regarded as accurate, even though they miss the so-called ground-truth pixels because labeling errors are supposed to exist during the pre-labeling process. This phenomenon also indicates that the trained U-net model has gained good recognition ability for concrete spalling and rebar exposure damages under the circumstances of wrong prior labeling information.

Deep learning-based multi-category disease semantic image segmentation detection for concrete structures using the Res-Unet model

Enhanced Concrete Crack Detection and Proactive Safety Warning Based on I-St-Unet Model

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

SV-UNet:A Lightweight Fracture Segmentation Model for Logging Images

Multi-band Feature Images Concrete Crack Segmentation Framework Using Deep Learning

Semantic segmentation of remote sensing images combined with attention mechanism and feature enhancement U-Net

Geometry-informed deep learning-based structural component segmentation of post-earthquake buildings

Automatic damage detection and segmentation using deep learning algorithms in reinforced concrete structure inspections

Crack Unet: Crack Recognition Algorithm Based on Three-Dimensional Ground Penetrating Radar Images

Deep Learning with Visual Explanations for Leakage Defect Segmentation of Metro Shield Tunnel

ResAt-UNet: A U-Shaped Network Using ResNet and Attention Module for Image Segmentation of Urban Buildings

A Robust Segmentation Method Based on Improved U-Net

Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network

Research on Segmentation of Steel Surface Defect Images Based on Improved Res-UNet Network

Multi-temporal crack segmentation in concrete structure using deep learning approaches

Autonomous Identification of Bridge Concrete Cracks Using Unmanned Aircraft Images and Improved Lightweight Deep Convolutional Networks

A Novel Multi-Scale Feature Enhancement U-Shaped Network for Pixel-Level Road Crack Segmentation

Medical Ultrasound Image Segmentation Based on Improved MultiResUNet Network

Toward enhancing concrete crack segmentation accuracy under complex scenarios: a novel modified U-Net network

Pixel-level Damage Detection for Concrete Spalling and Rebar Corrosion Based on U-net Semantic Segmentation

Autonomous Concrete Crack Semantic Segmentation Using Deep Fully Convolutional Encoder–Decoder Network in Concrete Structures Inspection