Abstract:Surface defect detection is an extremely crucial step to ensure the quality of industrial products. Nowadays, convolutional neural networks (CNNs) based on encoder–decoder architecture have achieved tremendous success in various defect detection tasks. However, the intrinsic locality of convolution prevents them from modeling long-range interactions explicitly, making it difficult to distinguish pseudo-defects in cluttered backgrounds. Recent transformers are especially skilled at learning global image dependencies, but with limited local structural information for the refined defect location. To overcome the above limitations, we incorporate CNN and transformer into an efficient hybrid transformer architecture for defect detection, termed Defect Transformer (DefT), to capture local and non-local relationships collaboratively. Specifically, in the encoder module, a convolutional stem block is firstly adopted to retain more spatial details. Then, the patch aggregation blocks are used to generate multi-scale representation with four hierarchies, each of them is followed by a series of DefT blocks, which respectively include a locally position-aware block for local position encoding, a lightweight multi-pooling self-attention to model multi-scale global contextual relationships with good computational efficiency, and a convolutional feed-forward network for feature transformation and further local information learning. Finally, a simple but effective decoder module is constructed to gradually recover spatial details from the skip connections in the encoder. Extensive experiments on three datasets demonstrate the superiority and efficiency of our method compared with other deeper and complex CNN- and transformer-based networks.

Swin Transformer Combined with Convolution Neural Network for Surface Defect Detection

Surface defect detection and classification of steel using an efficient Swin Transformer

Cas-VSwin transformer: A variant swin transformer for surface-defect detection

An End‐to‐end Steel Surface Defect Detection Approach Via Swin Transformer

Eswin-Unet: A Collaborative Model for Industrial Surface Defect Detection

Swin-Transformer -YOLOv5 for lightweight hot-rolled steel strips surface defect detection algorithm

A Dynamic Transformer Network With Early Exit Mechanism for Fast Detection of Multiscale Surface Defects

Defect transformer: An efficient hybrid transformer architecture for surface defect detection

Swin-RGC: Swin-Transformer with Recursive Gated Convolution for substation equipment non-rigid defect detection

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

A Shunted-Swin Transformer for Surface Defect Detection in Roller Bearings

Improved swin transformer-based defect detection method for transmission line patrol inspection images

Defect-aware transformer network for intelligent visual surface defect detection

Swin Transformer Network Leveraging Multi-Dimensional Features for Defect Depth Prediction

Hybrid Architecture Based on CNN and Transformer for Strip Steel Surface Defect Classification

A Weakly Supervised Surface Defect Detection Based on Convolutional Neural Network

A Multi-Scale Feature Fusion Network for Chip Surface Defect Detection

ETDNet: Efficient Transformer-Based Detection Network for Surface Defect Detection

A Surface Defect Detection Based On Convolutional Neural Network

Sparse cross-transformer network for surface defect detection

ST-CA YOLOv5: Improved YOLOv5 Based on Swin Transformer and Coordinate Attention for Surface Defect Detection