Abstract:Surface defect detection plays an increasing role in intelligent manufacturing and product life-cycle management, such as quality inspection, process monitoring, and preventive maintenance. The existing intelligent methods almost adopt convolution architecture, and the limited receptive field hinders performance improvement of defect detection. In general, a larger receptive field can bring richer contextual information, resulting in better performance. Although operations such as dilated convolution can expand the receptive field, this improvement is still limited. Recently, benefitting from the ability to model long-range dependencies, Transformer-based models achieve great success in computer vision and image processing. However, applying Transformer-based models without modification is not desirable because there is no awareness and pertinence to defects. In this paper, an intelligent method is proposed by using defect-aware Transformer network (DAT-Net). In DAT-Net, Transformer replaces convolution in encoder to overcome the difficulty of modeling long-range dependencies. Defect-aware module assembled by basic weight matrixes is incorporated into Transformer to perceive and capture geometry and characteristic of defect. Graph position encoding by constructing a dynamic graph on tokens is designed to provide auxiliary positional information, which brings desired improved performance and fine adaptability. Specially, we carry out field experiments and painstakingly construct blade defect and tool wear datasets to compare DAT-Net with other methods. The comprehensive experiments demonstrate that DAT-Net has superior performance with 90.19 mIoU on blade defect dataset and 87.24 mIoU on tool wear dataset.

Model of Oil Pipeline Tiny Defects Detection Based on DDPM Gated Parallel Convolutional Swin Transformer

A cascaded deep learning approach for detecting pipeline defects via pretrained YOLOv5 and ViT models based on MFL data

Multi-modal cascade detection of pipeline defects based on deep transfer metric learning

Swin-RGC: Swin-Transformer with Recursive Gated Convolution for substation equipment non-rigid defect detection

Multi-scale Attention and Dilation Network for Small Defect Detection

Improving Pipeline Magnetic Flux Leakage (MFL) Detection Performance With Mixed Attention Mechanisms (AMs) and Deep Residual Shrinkage Networks (DRSNs)

Improved swin transformer-based defect detection method for transmission line patrol inspection images

GM-DETR: Research on a Defect Detection Method Based on Improved DETR

Swin Transformer Combined with Convolution Neural Network for Surface Defect Detection

MDD-Net: A novel defect detection model of material microscope image

Transformer‐optimized generation, detection, and tracking network for images with drainage pipeline defects

Swin-Transformer -YOLOv5 for lightweight hot-rolled steel strips surface defect detection algorithm

DPiT: Detecting Defects of Photovoltaic Solar Cells With Image Transformers

Injurious or Noninjurious Defect Identification From MFL Images in Pipeline Inspection Using Convolutional Neural Network

Defect-aware transformer network for intelligent visual surface defect detection

An Estimation Method of Defect Size From MFL Image Using Visual Transformation Convolutional Neural Network

Deep Learning-Based Automatic Defect Detection Method for Sewer Pipelines

A Dynamic Transformer Network With Early Exit Mechanism for Fast Detection of Multiscale Surface Defects

Multi-modality Hierarchical Attention Networks for Defect Identification in Pipeline MFL Detection

DHT: Dynamic Vision Transformer Using Hybrid Window Attention for Industrial Defect Images Classification