Abstract:High-resolution (HR) crack image segmentation is crucial for accurate bridge safety diagnosis. However, accurately segmenting cracks with their slender topology and random distribution in HR images poses significant challenges. Additionally, the restricted memory capacity of graphics cards presents a significant limitation for HR image segmentation. To tackle this demanding task, a approach called Cascade CATransUNet, consisting of a coordinate attention-enhanced transformer architecture with a self-cascaded design, was proposed in this study. Firstly, CATransUNet, a transformer-based multi-scale feature extraction architecture with the embedment of the coordinate attention mechanism, is customized to enhance the extraction of the crack's main contour both horizontally and vertically. Then, a self-cascade refinement operation is introduced on the basis of CATransUNet to reconstruct the details of the extracted crack features from the global and local levels successively. Furthermore, an optimized boundary loss based on the joint cascade loss function is introduced to improve segmentation quality in boundary areas. The necessity and effectiveness of all the proposed improvements were demonstrated through ablation studies conducted on both open-sourced crack dataset and HR crack images collected on-site. Moreover, the advancement of the proposed method was confirmed in a parallel comparative experiment. The self-cascaded transformer architecture achieved impressive performance with mIoU, mBIoU, and DICE scores exceeding 89.83%, 85.78%, and 96.97% respectively, on HR (4 K) images. Finally, the proposed method was tested through an unmanned aerial vehicle (UAV)-based bridge crack inspection task. The utilization of the Cascade CATransUNet enabled the UAV to accurately detect cracks even from considerable distances. This improvement enhances safety and detection efficiency in UAV inspections, ensuring flexibility in selecting flight paths, thus providing technical support for the promotion and application of UAV-based bridge crack detection technology.

Dual attention transformer network for pixel-level concrete crack segmentation considering camera placement

Two-Stream Boundary-Aware Neural Network for Concrete Crack Segmentation and Quantification

FCT-Net: A dual-encoding-path network fusing atrous spatial pyramid pooling and transformer for pavement crack detection

Cracklab: A high-precision and efficient concrete crack segmentation and quantification network

PCTC-Net: A Crack Segmentation Network with Parallel Dual Encoder Network Fusing Pre-Conv-Based Transformers and Convolutional Neural Networks

Dual-path network combining CNN and transformer for pavement crack segmentation

CrackT-net: a Method of Convolutional Neural Network and Transformer for Crack Segmentation

A Convolutional-Transformer Network for Crack Segmentation with Boundary Awareness

A Crack-Segmentation Algorithm Fusing Transformers and Convolutional Neural Networks for Complex Detection Scenarios

A novel transformer-based network with attention mechanism for automatic pavement crack detection

Tiny‐Crack‐Net: A multiscale feature fusion network with attention mechanisms for segmentation of tiny cracks

CrackNet: A Hybrid Model for Crack Segmentation with Dynamic Loss Function

CrackViT: a unified CNN-transformer model for pixel-level crack extraction

UTE-CrackNet: transformer-guided and edge feature extraction U-shaped road crack image segmentation

CrackFormer Network for Pavement Crack Segmentation

Image-based Concrete Crack Detection in Tunnels Using Deep Fully Convolutional Networks

CNN-based Network with Multi-Scale Context Feature and Attention Mechanism for Automatic Pavement Crack Segmentation

Cracks Segmentation of Engineering Structures in Complex Backgrounds Using a Concatenation of Transformer and CNN Models Driven by Scene Understanding Information

Multi-scale feature fusion for pavement crack detection based on Transformer

A Transformer and Self-Cascade Operation-Based Architecture for Segmenting High-Resolution Bridge Cracks

Automatic Pixel‐Level Crack Detection and Measurement Using Fully Convolutional Network