Abstract:Pavement, as a kind of common public transit infrastructure, plays an important part in the daily passing and transportation-associated activities. The good conditions and smooth traffics of pavements matter significantly to the pavement users. However, due to long-time services, pavements often suffer from different kinds and severities of distresses, which might bring inconvenience to the pavement-related events, or even cause terrible traffic hazards. In this regard, we put forward a novel hybrid-window attentive vision transformer framework, called CrackFormer, for pavement crack detection aiming at providing an effective and automated solution to serving the pavement distress inspecting and repairing works. The CrackFormer employs a transformer-based high-resolution network architecture to rationally exploit and fuse multiscale feature semantics. To be specific, a hybrid-window based self-attention scheme is designed to extract feature semantics of entities both locally with dense windows and globally with sparse windows, which effectively improves the semantic details and accuracies. Moreover, a weighted multi-head self-attention philosophy is developed to recalibrate the contributions of different heads according to their relevance, which well enhances the feature encoding robustness and saliency. The CrackFormer is systematically tested on seven pavement crack detection datasets. Quantitative evaluations show that the CrackFormer achieves an overall performance with the precision of 0.9376, recall of 0.9352, and F 1 -score of 0.9364, respectively. In addition, qualitative examinations and comparative analyses all confirm the excellent performance of the CrackFormer for recognizing and delineating the pavement cracks of varying patterns under diverse pavement surface conditions.

Pavement crack detection based on transformer network

Quantitative Assessment of Cracks in Concrete Structures Using Active-Learning-integrated Transformer and Unmanned Robotic Platform

A novel transformer-based network with attention mechanism for automatic pavement crack detection

Multi-scale feature fusion for pavement crack detection based on Transformer

Detection of Pavement Cracks by Deep Learning Models of Transformer and UNet

Automatic Pavement Crack Detection Transformer Based on Convolutional and Sequential Feature Fusion

A Detection and Classification Method of Asphalt Pavement Crack based on Vision Transformer

Pavement crack detection with hybrid-window attentive vision transformers

Dual-path network combining CNN and transformer for pavement crack segmentation

An Improved YOLOv5 Crack Detection Method Combined With Transformer

A two-stage framework for pixel-level pavement surface crack detection

SwinCrack: Pavement crack detection using convolutional swin-transformer network

A Road Crack Segmentation Method Based on Transformer and Multi-Scale Feature Fusion

CrackViT: a unified CNN-transformer model for pixel-level crack extraction

CrackUNet: A Novel Network with Joint Network-in-network Structure and Deformable Convolution for Pavement Crack Detection

A Convolutional-Transformer Network for Crack Segmentation with Boundary Awareness

An average pooling designed Transformer for robust crack segmentation

Automated pixel-level pavement marking detection based on a convolutional transformer

Dual attention transformer network for pixel-level concrete crack segmentation considering camera placement

CrackT-net: a Method of Convolutional Neural Network and Transformer for Crack Segmentation

UTE-CrackNet: transformer-guided and edge feature extraction U-shaped road crack image segmentation