Abstract:Detecting cracks in building structures is an essential practice that ensures safety, promotes longevity, and maintains the economic value of the built environment. In the past, machine learning (ML) and deep learning (DL) techniques have been used to enhance classification accuracy. However, the conventional CNN (convolutional neural network) methods incur high computational costs owing to their extensive number of trainable parameters and tend to extract only high-dimensional shallow features that may not comprehensively represent crack characteristics. We proposed a novel convolution and composite attention transformer network (CCTNet) model to address these issues. CCTNet enhances crack identification by processing more input pixels and combining convolution channel attention with window-based self-attention mechanisms. This dual approach aims to leverage the localized feature extraction capabilities of CNNs with the global contextual understanding afforded by self-attention mechanisms. Additionally, we applied an improved cross-attention module within CCTNet to increase the interaction and integration of features across adjacent windows. The performance of CCTNet on the Historical Building Crack2019, SDTNET2018, and proposed DS3 has a precision of 98.60%, 98.93%, and 99.33%, respectively. Furthermore, the training validation loss of the proposed model is close to zero. In addition, the AUC (area under the curve) is 0.99 and 0.98 for the Historical Building Crack2019 and SDTNET2018, respectively. CCTNet not only outperforms existing methodologies but also sets a new standard for the accurate, efficient, and reliable detection of cracks in building structures.

Robust crack detection in masonry structures with Transformers

Quantitative Assessment of Cracks in Concrete Structures Using Active-Learning-integrated Transformer and Unmanned Robotic Platform

Enhanced Concrete Crack Detection and Proactive Safety Warning Based on I-St-Unet Model

Bridging Convolutional Neural Networks and Transformers for Efficient Crack Detection in Concrete Building Structures

Vision Mamba-based autonomous crack segmentation on concrete, asphalt, and masonry surfaces

An average pooling designed Transformer for robust crack segmentation

Detection of Pavement Cracks by Deep Learning Models of Transformer and UNet

Vision transformer-based autonomous crack detection on asphalt and concrete surfaces

CrackViT: a unified CNN-transformer model for pixel-level crack extraction

Structural Crack Detection Using Deep Learning–based Fully Convolutional Networks

A Convolutional-Transformer Network for Crack Segmentation with Boundary Awareness

TransCrack: Revisiting Fine-Grained Road Crack Detection with a Transformer Design.

CNN-Transformer hybrid network for concrete dam crack patrol inspection

Unifying transformer and convolution for dam crack detection

An improved transformer-based concrete crack classification method

Dual attention transformer network for pixel-level concrete crack segmentation considering camera placement

Pavement crack detection based on transformer network

Application of machine learning for crack detection on concrete structures using CNN architecture

CrackNet: A Hybrid Model for Crack Segmentation with Dynamic Loss Function

CrackT-net: a Method of Convolutional Neural Network and Transformer for Crack Segmentation

Concrete Surface Crack Detection with Convolutional-based Deep Learning Models