An Ensemble Approach for Robust Automated Crack Detection and Segmentation in Concrete Structures

Muhammad Sohaib,Saima Jamil,Jong-Myon Kim

DOI: https://doi.org/10.3390/s24010257

IF: 3.9

2024-01-01

Sensors

Abstract:To prevent potential instability the early detection of cracks is imperative due to the prevalent use of concrete in critical infrastructure. Automated techniques leveraging artificial intelligence, machine learning, and deep learning as the traditional manual inspection methods are time-consuming. The existing automated concrete crack detection algorithms, despite recent advancements, face challenges in robustness, particularly in precise crack detection amidst complex backgrounds and visual distractions, while also maintaining low inference times. Therefore, this paper introduces a novel ensemble mechanism based on multiple quantized You Only Look Once version 8 (YOLOv8) models for the detection and segmentation of cracks in concrete structures. The proposed model is tested on different concrete crack datasets yielding enhanced segmentation results with at least 89.62% precision and intersection over a union score of 0.88. Moreover, the inference time per image is reduced to 27 milliseconds which is at least a 5% improvement over other models in the comparison. This is achieved by amalgamating the predictions of the trained models to calculate the final segmentation mask. The noteworthy contributions of this work encompass the creation of a model with low inference time, an ensemble mechanism for robust crack segmentation, and the enhancement of the learning capabilities of crack detection models. The fast inference time of the model renders it appropriate for real-time applications, effectively tackling challenges in infrastructure maintenance and safety.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

The paper aims to address the problem of crack detection and segmentation in concrete structures. Specifically, the research focuses on the following key points:

1. **Improving Detection Robustness**: Although existing automated crack detection algorithms have made some progress, they still face challenges in accurately detecting cracks in complex backgrounds, especially in the presence of significant visual interference.

2. **Reducing Inference Time**: Existing methods often struggle to achieve fast inference while maintaining high accuracy, which is a limiting factor for real-time applications.

To address the above issues, the paper proposes an ensemble method based on multiple quantized YOLOv8 models. The key features of this method include:

- **Multi-Model Ensemble**: Utilizing three different sizes (small, medium, large) of YOLOv8 models to create an ensemble model, with each model trained on different subsets of images to ensure the model can learn diverse features and prevent overfitting.

- **Model Quantization**: Quantizing the model by reducing the precision of model weights and activations, which helps to reduce the memory footprint, improve inference speed, and lower latency.

- **Ensemble Prediction**: Generating the final segmentation mask by combining the predictions of multiple models, which improves the accuracy of crack detection and segmentation.

Experimental results show that this method achieves at least 89.62% accuracy and an Intersection over Union (IoU) of 0.88 on multiple concrete crack datasets, and reduces the inference time per image to 27 milliseconds, which is at least a 5% improvement over other models. These improvements make the model highly suitable for real-time applications, effectively addressing challenges in infrastructure maintenance and safety.