Abstract:In recent years, the evolution of convolutional neural networks (CNNs) has paved the way for the development of deep-learning-based visual inspection techniques to identify damages in concrete bridges. However, the coexistence of diverse damage attributes within a single image complicates the comprehensive interpretation of these images during practical bridge inspections, posing a persistent challenge for existing single classification tasks. To address this issue, we introduce an innovative algorithm that synergizes graph convolutional network (GCN) and multiaxis vision transformer (MaxViT). Our approach leverages MaxViT to extract image features and subsequently models the co-occurrence correlation of labels. In addition, we use a graph CNN to extract features that capture the correlation between labels. Ultimately, we integrate these image features to enable multilabel classification of damage images. To evaluate the efficacy of our method, we curated a multilabel damage classification dataset for concrete bridges, consisting of 2098 samples encompassing the four prevalent types of spall, rebar, corrosion, and crack observed during bridge inspections. Experimental results showcase that our proposed method achieves a mean average precision (mAP) of 99.37% when applied to real bridge inspection images. In terms of general evaluation metrics, our method attains an accuracy of 98.29%, precision of 96.28%, recall of 97.08%, and F1-score of 96.68%. These findings underscore the superior performance of our method compared with current advanced multilabel classification networks, demonstrating higher accuracy. An interpretable analysis of the classification feature maps generated by our model, using the Grad-CAM algorithm, reveals that the model effectively directs attention to specific regions where damage is located. Consequently, our method holds promising engineering applications and has the potential to significantly enhance the accuracy of support provided for bridge inspection and maintenance endeavors.

Multi-label Classification for Concrete Defects Based on EfficientNetV2

Multiple Classification Network of Concrete Defects Based on Improved EfficientNetV2.

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

A real-time multi-defect automatic identification framework for concrete dams via improved YOLOv5 and knowledge distillation

A Wafer Surface Defect Detection Method Built on Generic Object Detection Network

Detection of Defects on Metal Surfaces Based on PoolFormer Auto-Encoder

Multi-scale Attention and Dilation Network for Small Defect Detection

Multi-label image recognition for electric power equipment inspection based on multi-scale dynamic graph convolution network

YOLOv8-CDD:An Improved Concrete Defect Detection Method Combined CNN with Transformer

A deep transfer learning-based algorithm for concrete surface defect detection

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

Deep residual network training for reinforced concrete defects intelligent classifier

Multi-label Concrete Bridge Damage Classification Using Graph Convolution

Meta-Learning Convolutional Neural Architectures for Multi-Target Concrete Defect Classification With the COncrete DEfect BRidge IMage Dataset

An Efficient End-to-End Multitask Network Architecture for Defect Inspection

A robust weakly supervised learning of deep Conv-Nets for surface defect inspection

Performance Comparison of Multiple Convolutional Neural Networks for Concrete Defects Classification

Concrete Defect Localization Based on Multilevel Convolutional Neural Networks

MSF-Net: Multi-Scale Feature Learning Network for Classification of Surface Defects of Multifarious Sizes

A New Multiscale Multiattention Convolutional Neural Network for Fine-Grained Surface Defect Detection

An Intelligent Classification Model for Surface Defects on Cement Concrete Bridges