Abstract:Artificial Intelligence (AI) and allied disruptive technologies have revolutionized the scientific world. However, civil engineering, in general, and infrastructure management, in particular, are lagging behind the technology adoption curves. Crack identification and assessment are important indicators to assess and evaluate the structural health of critical city infrastructures such as bridges. Historically, such critical infrastructure has been monitored through manual visual inspection. This process is costly, time-consuming, and prone to errors as it relies on the inspector's knowledge and the gadgets' precision. To save time and cost, automatic crack and damage detection in bridges and similar infrastructure is required to ensure its efficacy and reliability. However, an automated and reliable system does not exist, particularly in developing countries, presenting a gap targeted in this study. Accordingly, we proposed a two-phased deep learning-based framework for smart infrastructure management to assess the conditions of bridges in developing countries. In the first part of the study, we detected cracks in bridges using the dataset from Pakistan and the online-accessible SDNET2018 dataset. You only look once version 5 (YOLOv5) has been used to locate and classify cracks in the dataset images. To determine the main indicators (precision, recall, and mAP (0.5)), we applied each of the YOLOv5 s, m, and l models to the dataset using a ratio of 7:2:1 for training, validation, and testing, respectively. The mAP (Mean average precision) values of all the models were compared to evaluate their performance. The results show mAP values for the test set of the YOLOv5 s, m, and l as 97.8%, 99.3%, and 99.1%, respectively, indicating the superior performance of the YOLOv5 m model compared to the two counterparts. In the second portion of the study, segmentation of the crack is carried out using the U-Net model to acquire their exact pixels. Using the segmentation mask allocated to the attribute extractor, the pixel's width, height, and area are measured and visualized on scatter plots and Boxplots to segregate different cracks. Furthermore, the segmentation part validated the output of the proposed YOLOv5 models. This study not only located and classified the cracks based on their severity level, but also segmented the crack pixels and measured their width, height, and area per pixel under different lighting conditions. It is one of the few studies targeting low-cost health assessment and damage detection in bridges of developing countries that otherwise struggle with regular maintenance and rehabilitation of such critical infrastructure. The proposed model can be used by local infrastructure monitoring and rehabilitation authorities for regular condition and health assessment of the bridges and similar infrastructure to move towards a smarter and automated damage assessment system.

Automated Pavement Cracks Detection and Classification Using Deep Learning

An automatic image processing based on Hough transform algorithm for pavement crack detection and classification

Visual Detection of Road Cracks for Autonomous Vehicles Based on Deep Learning

Machine learning-based pavement crack detection, classification, and characterization: a review

An Efficient and Scalable Deep Learning Approach for Road Damage Detection

Research on Asphalt Pavement Disease Detection Based on Improved YOLOv5s

Pavement health 4.0: a novel AI-enabled PavementVision approach for pavement health monitoring and classification

Automated Pavement Distress Detection Using Image Processing Techniques

Deep Learning-based Road Crack Detection Technology

Detection of Road Cracks Using Convolutional Neural Networks and Threshold Segmentation

Advancing Pavement Distress Detection in Developing Countries: A Novel Deep Learning Approach with Locally-Collected Datasets

Automated Pavement Condition Index Assessment with Deep Learning and Image Analysis: An End-to-End Approach

Deep machine learning approach to develop a new asphalt pavement condition index

Smart and Automated Infrastructure Management: A Deep Learning Approach for Crack Detection in Bridge Images

Automated pavement distress detection using region based convolutional neural networks

Deep Learning-Based Crack Detection: A Survey

Automatic Damage Detection of Pavement through DarkNet Analysis of Digital, Infrared, and Multi-Spectral Dynamic Imaging Images

Novel Road Crack Detection Technology Based on Deep Learning

Improved YOLOv5-Based Real-Time Road Pavement Damage Detection in Road Infrastructure Management

Development of AI- and Robotics-Assisted Automated Pavement-Crack-Evaluation System

Three-Stage Pavement Crack Localization and Segmentation Algorithm Based on Digital Image Processing and Deep Learning Techniques