Abstract:Recently, computer vision-based methods have been successfully applied in many industrial fields. Nevertheless, automated detection of steel surface defects remains a challenge due to the complexity of surface defects. To solve this problem, many models have been proposed, but these models are not good enough to detect all defects. After analyzing the previous research, we believe that the single-task network cannot fully meet the actual detection needs owing to its own characteristics. To address this problem, an end-to-end multi-task network has been proposed. It consists of one encoder and two decoders. The encoder is used for feature extraction, and the two decoders are used for object detection and semantic segmentation, respectively. In an effort to deal with the challenge of changing defect scales, we propose the Depthwise Separable Atrous Spatial Pyramid Pooling module. This module can obtain dense multi-scale features at a very low computational cost. After that, Residually Connected Depthwise Separable Atrous Convolutional Blocks are used to extract spatial information under low computation for better segmentation prediction. Furthermore, we investigate the impact of training strategies on network performance. The performance of the network can be optimized by adopting the strategy of training the segmentation task first and using the deep supervision training method. At length, the advantages of object detection and semantic segmentation are tactfully combined. Our model achieves mIOU 79.37% and mAP@0.5 78.38% on the NEU dataset. Comparative experiments demonstrate that this method has apparent advantages over other models. Meanwhile, the speed of detection amount to 85.6 FPS on a single GPU, which is acceptable in the practical detection process.

Hierarchical Multi-Scale Network for Cross-Scale Visual Defect Detection

A Wafer Surface Defect Detection Method Built on Generic Object Detection Network

Multi-scale Attention and Dilation Network for Small Defect Detection

Small-scale defect detection in industrial environment based on lightweight deep learning network

LE–MSFE–DDNet: a defect detection network based on low-light enhancement and multi-scale feature extraction

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

MSF-Net: Multi-Scale Feature Learning Network for Classification of Surface Defects of Multifarious Sizes

An Efficient End-to-End Multitask Network Architecture for Defect Inspection

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

A New Multiscale Multiattention Convolutional Neural Network for Fine-Grained Surface Defect Detection

A Pixel-Level Segmentation Convolutional Neural Network Based on Global and Local Feature Fusion for Surface Defect Detection

An Efficient Network for Surface Defect Detection

MTA-Net: A One-Stage Detector Based on a Multiscale Task-Aligned Network for Catenary Support Components

PGA-Net: Pyramid Feature Fusion and Global Context Attention Network for Automated Surface Defect Detection

MRMNet: Multi-scale residual multi-branch neural network for object detection

Multi-scale coupled attention for visual object detection

A Maritime Targets Detection Method Based on Hierarchical and Multi-Scale Deep Convolutional Neural Network

Multi-Scale Interactive Network for Salient Object Detection

MFNet: A Novel Multilevel Feature Fusion Network With Multibranch Structure for Surface Defect Detection

A hierarchical attention detector for bearing surface defect detection