Pixelwise asphalt concrete pavement crack detection via deep learning‐based semantic segmentation method
Ju Huyan,Tao Ma,Wei Li,Handuo Yang,Zhengchao Xu
DOI: https://doi.org/10.1002/stc.2974
2022-04-05
Structural Control and Health Monitoring
Abstract:SummaryExplicit gaps exist between the advanced deep learning technologies and the less satisfied pixel‐level crack detection algorithms. Therefore, this research sought to bridge this gap via outlining the deep neural network model for pixelwise pavement crack detection. Two state‐of‐the‐art deep neural network models are constructed for the semantic segmentation of crack images. The first architecture, VGGCrackU‐net, is composed of 10 3×3<span class="mjpage mjpage__block"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.165ex" height="2.176ex" style="vertical-align: -0.338ex;" viewBox="0 -791.3 2223.9 936.9" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMAIN-33" x="0" y="0"></use> <use xlink:href="#MJMAIN-D7" x="722" y="0"></use> <use xlink:href="#MJMAIN-33" x="1723" y="0"></use></g></svg></span> convolutional layers, 4 max‐pooling layers, 4 up‐sampling layers, and 4 concatenate operations. Another architecture, ResCrackU‐net, is composed of 7‐level residual units with a total of 22 convolutional layers. Asphalt concrete pavement crack images are collected by smartphones, action cameras, and automatic pavement monitoring systems from diverse functional classes of AC pavements. The crack images are manually labeled and double‐checked by trained operators for quality insurance. After that, 500 crack images are randomly divided into training, validating, and test datasets according to the ratio of 3:1:1. Both architectures are trained on GPU facilitated Keras platform with Python version of 3.5, which demonstrated fast convergence. Results prove that the proposed models exhibit significant advantages for pixelwise crack detection when compared with the performance of widely used FCN net and PSPnet. Meanwhile, ResCrackU‐net slightly outperforms VGGCrackU‐net, which, however, can provide acceptable results as well. Though significant false negative and false positive errors are observed in both network models, the contributions are noticeable, which can provide innovative guidance for future work in figuring out solutions to the problems.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path></defs></svg>
construction & building technology,engineering, civil,instruments & instrumentation