Abstract:Recently, computer vision-based methods have been successfully applied in many industrial fields. Nevertheless, automated detection of steel surface defects remains a challenge due to the complexity of surface defects. To solve this problem, many models have been proposed, but these models are not good enough to detect all defects. After analyzing the previous research, we believe that the single-task network cannot fully meet the actual detection needs owing to its own characteristics. To address this problem, an end-to-end multi-task network has been proposed. It consists of one encoder and two decoders. The encoder is used for feature extraction, and the two decoders are used for object detection and semantic segmentation, respectively. In an effort to deal with the challenge of changing defect scales, we propose the Depthwise Separable Atrous Spatial Pyramid Pooling module. This module can obtain dense multi-scale features at a very low computational cost. After that, Residually Connected Depthwise Separable Atrous Convolutional Blocks are used to extract spatial information under low computation for better segmentation prediction. Furthermore, we investigate the impact of training strategies on network performance. The performance of the network can be optimized by adopting the strategy of training the segmentation task first and using the deep supervision training method. At length, the advantages of object detection and semantic segmentation are tactfully combined. Our model achieves mIOU 79.37% and mAP@0.5 78.38% on the NEU dataset. Comparative experiments demonstrate that this method has apparent advantages over other models. Meanwhile, the speed of detection amount to 85.6 FPS on a single GPU, which is acceptable in the practical detection process.

A Dynamic Transformer Network With Early Exit Mechanism for Fast Detection of Multiscale Surface Defects

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Defect transformer: An efficient hybrid transformer architecture for surface defect detection

CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation

Defect-aware transformer network for intelligent visual surface defect detection

An Efficient Network for Surface Defect Detection

A Multi-scale Normalizing Flow Network for Surface Defects Detection

Swin Transformer Combined with Convolution Neural Network for Surface Defect Detection

ETDNet: Efficient Transformer-Based Detection Network for Surface Defect Detection

Multiscale Local and Global Feature Fusion for the Detection of Steel Surface Defects

Sparse cross-transformer network for surface defect detection

Multi-scale Attention and Dilation Network for Small Defect Detection

An Efficient End-to-End Multitask Network Architecture for Defect Inspection

Hybrid Architecture Based on CNN and Transformer for Strip Steel Surface Defect Classification

Multi-Scale Lightweight Neural Network for Steel Surface Defect Detection

MSF-Net: Multi-Scale Feature Learning Network for Classification of Surface Defects of Multifarious Sizes

Attention-Based Multiscale Feature Fusion for Efficient Surface Defect Detection

MFNet: A Novel Multilevel Feature Fusion Network With Multibranch Structure for Surface Defect Detection

A New Multiscale Multiattention Convolutional Neural Network for Fine-Grained Surface Defect Detection

Surface defect detection and classification of steel using an efficient Swin Transformer

An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features