Abstract:Structural Health Monitoring, Ahead of Print. Although structural damage recognition has been extensively investigated using deep learning and computer vision (CV) techniques, the following limitations exist for real-world applications: (1) the accuracy heavily relies on a large volume of network parameters; (2) the sensitivity to tiny cracks is limited due to low contrast between microcrack and background pixels; (3) the robustness on complex cracks with various morphological features and surface disturbances is inadequate. To address these issues, this study proposes a lightweight, accurate, and robust semantic segmentation method of complex structural damage recognition for actual bridges. Firstly, a modified DeepLabv3+ model is established using the lightweight MobileNetV2 backbone and transposed convolutions to reduce parameter volume and enhance the recognition capability of local minor damages. Secondly, the depthwise separable convolution is utilized instead of the standard convolution to decouple the spatial and channel interactions of feature maps. Thirdly, a refined atrous spatial pyramid pooling (ASPP) module is constructed at the backbone end using multilevel dilated convolutions to expand the receptive fields. Finally, a piecewise synthetical loss function based on focal and dice losses is designed for different training stages. A total of 3226 actual crack images in different scales, resolutions, and scenes are utilized to verify the proposed method. The results show that the mean intersection-over-union for complex cracks in various real-world scenarios reaches 0.776 with significant reductions of 91.5% in parameter volume and 38.9% in recognition time. Comparative studies demonstrate the superiority of the proposed method over existing lightweight crack segmentation models based on SegNet and DenseNet. In addition, ablation experiments demonstrate the necessity and effectiveness of the MobileNetV2 backbone, refined ASPP module, and piecewise synthetical loss function. Moreover, the robustness and expandability of the proposed method on new structural damage categories (including concrete spalling, rebar exposure, and cable corrosion) are also verified.

A novel transformer-based semantic segmentation framework for structural condition assessment

Quantitative Assessment of Cracks in Concrete Structures Using Active-Learning-integrated Transformer and Unmanned Robotic Platform

Dual-Tasks Siamese Transformer Framework for Building Damage Assessment

Cracks Segmentation of Engineering Structures in Complex Backgrounds Using a Concatenation of Transformer and CNN Models Driven by Scene Understanding Information

Transformer‐based framework for accurate segmentation of high‐resolution images in structural health monitoring

Rethinking Transformers for Semantic Segmentation of Remote Sensing Images.

Image segmentation using Vision Transformer for tunnel defect assessment

TSCB-Net: transformer-enhanced semantic segmentation of surface damage of concrete bridges

A novel transformer-based network with attention mechanism for automatic pavement crack detection

PSSD-Transformer: Powerful Sparse Spike-Driven Transformer for Image Semantic Segmentation

High-Resolution Vision Transformers for Pixel-Level Identification of Structural Components and Damage

Improved Swin Transformer-Based Semantic Segmentation of Postearthquake Dense Buildings in Urban Areas Using Remote Sensing Images

Efficient Transformer for Remote Sensing Image Segmentation

A hierarchical semantic segmentation framework for computer vision-based bridge damage detection

Dmg2Former-AR: Vision Transformers with Adaptive Rescaling for High-Resolution Structural Visual Inspection

A Road Crack Segmentation Method Based on Transformer and Multi-Scale Feature Fusion

Transformer-based semantic segmentation for large-scale building footprint extraction from very-high resolution satellite images

Lightweight semantic segmentation of complex structural damage recognition for actual bridges

Automatic crack detection on concrete and asphalt surfaces using semantic segmentation network with hierarchical Transformer

Point Cloud Semantic Segmentation with Adaptive Spatial Structure Graph Transformer

A Transformer and Self-Cascade Operation-Based Architecture for Segmenting High-Resolution Bridge Cracks