Abstract:Artificial Intelligence (AI) and allied disruptive technologies have revolutionized the scientific world. However, civil engineering, in general, and infrastructure management, in particular, are lagging behind the technology adoption curves. Crack identification and assessment are important indicators to assess and evaluate the structural health of critical city infrastructures such as bridges. Historically, such critical infrastructure has been monitored through manual visual inspection. This process is costly, time-consuming, and prone to errors as it relies on the inspector's knowledge and the gadgets' precision. To save time and cost, automatic crack and damage detection in bridges and similar infrastructure is required to ensure its efficacy and reliability. However, an automated and reliable system does not exist, particularly in developing countries, presenting a gap targeted in this study. Accordingly, we proposed a two-phased deep learning-based framework for smart infrastructure management to assess the conditions of bridges in developing countries. In the first part of the study, we detected cracks in bridges using the dataset from Pakistan and the online-accessible SDNET2018 dataset. You only look once version 5 (YOLOv5) has been used to locate and classify cracks in the dataset images. To determine the main indicators (precision, recall, and mAP (0.5)), we applied each of the YOLOv5 s, m, and l models to the dataset using a ratio of 7:2:1 for training, validation, and testing, respectively. The mAP (Mean average precision) values of all the models were compared to evaluate their performance. The results show mAP values for the test set of the YOLOv5 s, m, and l as 97.8%, 99.3%, and 99.1%, respectively, indicating the superior performance of the YOLOv5 m model compared to the two counterparts. In the second portion of the study, segmentation of the crack is carried out using the U-Net model to acquire their exact pixels. Using the segmentation mask allocated to the attribute extractor, the pixel's width, height, and area are measured and visualized on scatter plots and Boxplots to segregate different cracks. Furthermore, the segmentation part validated the output of the proposed YOLOv5 models. This study not only located and classified the cracks based on their severity level, but also segmented the crack pixels and measured their width, height, and area per pixel under different lighting conditions. It is one of the few studies targeting low-cost health assessment and damage detection in bridges of developing countries that otherwise struggle with regular maintenance and rehabilitation of such critical infrastructure. The proposed model can be used by local infrastructure monitoring and rehabilitation authorities for regular condition and health assessment of the bridges and similar infrastructure to move towards a smarter and automated damage assessment system.

Detection and Location of Steel Structure Trestle Surface Cracks Based on Consumer-grade Camera System

A Three-Step Computer Vision-Based Framework for Concrete Crack Detection and Dimensions Identification

Establishment and Application of Crowd-Sensing-Based System for Bridge Structural Crack Detection

3D vision technologies for a self-developed structural external crack damage recognition robot

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

Smartphone-based structural crack detection using pruned fully convolutional networks and edge computing

Intelligent segmentation and quantification of tunnel lining cracks via computer vision

High-Precision Surface Crack Detection for Rolling Steel Production Equipment in ICPS

ECF-STPM: A Robust Crack Detection Method for Railway Catenary Components

Automatic Crack Detection and Calculation Based on Deep Learning and Digital Image Processing

Robust surface crack detection with structure line guidance

Defect Detection and Health Monitoring of Steel Structure based on UAV Integrated with Image Processing System

MSCNet: A Framework With a Texture Enhancement Mechanism and Feature Aggregation for Crack Detection

Computer Vision-Based Bridge Damage Detection Using Deep Convolutional Networks with Expectation Maximum Attention Module

A novel intelligent inspection robot with deep stereo vision for three-dimensional concrete damage detection and quantification

Smart and Automated Infrastructure Management: A Deep Learning Approach for Crack Detection in Bridge Images

Automated bridge surface crack detection and segmentation using computer vision-based deep learning model

Machine vision-based surface crack analysis for transportation infrastructure

Automated Crack Detection on Concrete Bridges

Concrete Crack Identification and Image Mosaic Based on Image Processing

Deep Learning-Based Concrete Surface Damage Monitoring Method Using Structured Lights and Depth Camera