Abstract:Recently, computer vision-based methods have been successfully applied in many industrial fields. Nevertheless, automated detection of steel surface defects remains a challenge due to the complexity of surface defects. To solve this problem, many models have been proposed, but these models are not good enough to detect all defects. After analyzing the previous research, we believe that the single-task network cannot fully meet the actual detection needs owing to its own characteristics. To address this problem, an end-to-end multi-task network has been proposed. It consists of one encoder and two decoders. The encoder is used for feature extraction, and the two decoders are used for object detection and semantic segmentation, respectively. In an effort to deal with the challenge of changing defect scales, we propose the Depthwise Separable Atrous Spatial Pyramid Pooling module. This module can obtain dense multi-scale features at a very low computational cost. After that, Residually Connected Depthwise Separable Atrous Convolutional Blocks are used to extract spatial information under low computation for better segmentation prediction. Furthermore, we investigate the impact of training strategies on network performance. The performance of the network can be optimized by adopting the strategy of training the segmentation task first and using the deep supervision training method. At length, the advantages of object detection and semantic segmentation are tactfully combined. Our model achieves mIOU 79.37% and mAP@0.5 78.38% on the NEU dataset. Comparative experiments demonstrate that this method has apparent advantages over other models. Meanwhile, the speed of detection amount to 85.6 FPS on a single GPU, which is acceptable in the practical detection process.

A Lightweight Fine-Grained Perception Defect Inspection Network Under Multitask Learning on Highly Reflective Surface

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

Fusion of multi-light source illuminated images for effective defect inspection on highly reflective surfaces

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Visual Defect Inspection of Metal Part Surface via Deformable Convolution and Concatenate Feature Pyramid Neural Networks

A Lightweight Deep Learning Network with an Optimized Attention Module for Aluminum Surface Defect Detection

AEGLR-Net

Multi-scale Attention and Dilation Network for Small Defect Detection

An Efficient End-to-End Multitask Network Architecture for Defect Inspection

A Dynamic Transformer Network With Early Exit Mechanism for Fast Detection of Multiscale Surface Defects

A hierarchical attention detector for bearing surface defect detection

DeepInspection: Deep learning based hierarchical network for specular surface inspection

A New Multiscale Multiattention Convolutional Neural Network for Fine-Grained Surface Defect Detection

HLU 2 -Net: A Residual U-Structure Embedded U-Net With Hybrid Loss for Tire Defect Inspection

LE–MSFE–DDNet: a defect detection network based on low-light enhancement and multi-scale feature extraction

Joint Attention-Guided Feature Fusion Network for Saliency Detection of Surface Defects

A Feature Memory Rearrangement Network for Visual Inspection of Textured Surface Defects Toward Edge Intelligent Manufacturing

An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features

Normal Reference Attention and Defective Feature Perception Network for Surface Defect Detection

Detection and Segmentation of Manufacturing Defects with Convolutional Neural Networks and Transfer Learning