Pixel-level bridge crack detection using a deep fusion about recurrent residual convolution and context encoder network

Gang Li,Xiyuan Li,Jian Zhou,Dezhi Liu,Wei Ren
DOI: https://doi.org/10.1016/j.measurement.2021.109171
IF: 5.6
2021-05-01
Measurement
Abstract:<p>To cope with the complex bridge crack detection environment, we developed a flexible crack identification system. Firstly, the acquired images are processed by sliding window technology to construct a bridge crack dataset. Then we propose a trainable context encoder network which uses the recurrent residual convolutional neural network (RRCNN) to improve the encoder structure to better extract low-level features. Additionally, it combines dense atrous convolution block (DAC) and residual multi-kernel pooling block (RMP) which can retain more crack information and features from the crack image, as well as improve the performance of crack segmentation. Finally, our research results are validated in the developed software platform. The experiments show that our method is more stable and accurate than other methods, its accuracy and mean intersection over union(mIoU) have reached 98.62% and 80.93%, respectively. Moreover, it performs well in cracks facing complex conditions, which can be applied to the bridge maintenance projects.</p>
engineering, multidisciplinary,instruments & instrumentation
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to improve the accuracy and efficiency of crack detection in complex bridge crack detection environments. Specifically, traditional bridge crack detection methods are not only time - consuming and labor - intensive, but also manual detection methods may threaten the personal safety of detection personnel. Therefore, it is necessary to develop an automated bridge crack detection method to discover and repair cracks in a timely manner while reducing the risks and workloads of detection personnel. In addition, existing image processing and machine learning methods perform poorly when dealing with cracks under low - contrast or highly cluttered conditions. Although deep - learning methods have improved the accuracy and efficiency of crack detection, there are still some problems in semantic segmentation tasks, such as the loss of some position information caused by pooling layers. To this end, the author proposes a new encoder - decoder structure, namely R2CE - Net. By introducing the Recursive Residual Convolutional Neural Network (RRCNN) block to improve the encoder structure, it can better extract low - level features. At the same time, by combining the Densely Atrous Convolution (DAC) block and the Residual Multi - Kernel Pooling (RMP) block, more crack information and features are retained, thereby improving the performance of crack segmentation. The experimental results show that the accuracy and mean Intersection over Union (mIoU) of this method in crack image segmentation reach 98.62% and 80.93% respectively, and it performs well when facing cracks under complex conditions and is suitable for bridge maintenance projects.