Abstract:Visual surface defect inspection provides an important tool for product quality assessment in a wide range of industrial applications. In recent years, diverse convolutional neural network (CNN) models have been devel-oped for the high-accuracy image classification of natural objects. However, it remains a challenging task to develop deep-learning-based approaches for surface defect inspection of industrial products. The main challenge is that surface defects of industrial products occur in low probability, therefore it is impractical to build a large image dataset containing different types of defects to train/fine-tune deep CNN models to achieve satisfactory performance when applied to industrial inspection tasks. To overcome the above-mentioned problem, we build a light-weight defect classification model based on the pre-trained SqueezeNet architecture and present three effective techniques to achieve high-accuracy defect classification using very few collected defective training samples. First, we experimentally demonstrate that it is reasonable to freeze shallower convolutional layers and only fine-tune deeper layers in the last convolutional stage when there are not enough training samples. Second, we integrate batch-size independent Group Normalization (GN) into SqueezeNet to compute stable statistics based on a limited number of defective samples for training the classification model. Third, we add an auxiliary task to perform the similarity comparison of two defective samples during the training phase, significantly increasing the size of the training data and generating more distinctive defect-specific representations. The experimental results on the NEU-CLS dataset and USB-FS dataset verify the effectiveness of the proposed method. Our method can obtain accurate defect classification results when very few defective training samples are provided, i.e., about 97.69% and 82.92% average classification accuracy on the NEU-CLS and USB-FS datasets, respectively, under the 5-shot setting (5 images per defect category).

Fusion of multi-light source illuminated images for effective defect inspection on highly reflective surfaces

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Smooth Surface Defect Detection by Deep Learning Based on Wrapped Phase Map

An Effective Industrial Defect Classification Method under the Few-Shot Setting Via Two-Stream Training

Attention-Based Multiscale Feature Fusion for Efficient Surface Defect Detection

Visual Defect Inspection of Metal Part Surface via Deformable Convolution and Concatenate Feature Pyramid Neural Networks

A deep-learning-based approach for fast and robust steel surface defects classification

Defect classification for specular surfaces based on deflectometry and multi-modal fusion network

Multi-Sensor Image Fusion Method for Defect Detection in Powder Bed Fusion

A Lightweight Fine-Grained Perception Defect Inspection Network Under Multitask Learning on Highly Reflective Surface

An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features

Defect segmentation for multi-illumination quality control systems

An adaptive weighting multimodal fusion classification system for steel plate surface defect

DeepInspection: Deep learning based hierarchical network for specular surface inspection

Joint Attention-Guided Feature Fusion Network for Saliency Detection of Surface Defects

Multiscale Local and Global Feature Fusion for the Detection of Steel Surface Defects

A Light-Weight Deep-Learning Model with Multi-Scale Features for Steel Surface Defect Classification

A deep convolutional network combining layerwise images and defect parameter vectors for laser powder bed fusion process anomalies classification

CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation

A Lightweight Spatial and Temporal Multi-Feature Fusion Network for Defect Detection