Abstract:Visual surface defect inspection provides an important tool for product quality assessment in a wide range of industrial applications. In recent years, diverse convolutional neural network (CNN) models have been devel-oped for the high-accuracy image classification of natural objects. However, it remains a challenging task to develop deep-learning-based approaches for surface defect inspection of industrial products. The main challenge is that surface defects of industrial products occur in low probability, therefore it is impractical to build a large image dataset containing different types of defects to train/fine-tune deep CNN models to achieve satisfactory performance when applied to industrial inspection tasks. To overcome the above-mentioned problem, we build a light-weight defect classification model based on the pre-trained SqueezeNet architecture and present three effective techniques to achieve high-accuracy defect classification using very few collected defective training samples. First, we experimentally demonstrate that it is reasonable to freeze shallower convolutional layers and only fine-tune deeper layers in the last convolutional stage when there are not enough training samples. Second, we integrate batch-size independent Group Normalization (GN) into SqueezeNet to compute stable statistics based on a limited number of defective samples for training the classification model. Third, we add an auxiliary task to perform the similarity comparison of two defective samples during the training phase, significantly increasing the size of the training data and generating more distinctive defect-specific representations. The experimental results on the NEU-CLS dataset and USB-FS dataset verify the effectiveness of the proposed method. Our method can obtain accurate defect classification results when very few defective training samples are provided, i.e., about 97.69% and 82.92% average classification accuracy on the NEU-CLS and USB-FS datasets, respectively, under the 5-shot setting (5 images per defect category).

ACAT-transformer: Adaptive Classifier with Attention-Wise Transformation for Few-Sample Surface Defect Recognition

Sparse cross-transformer network for surface defect detection

An Effective Industrial Defect Classification Method under the Few-Shot Setting Via Two-Stream Training

Defect-aware transformer network for intelligent visual surface defect detection

Coarse-to-Fine Few-Shot Defect Recognition with Dynamic Weighting and Joint Metric

Steel surface defect detection based on sparse global attention transformer

A Deep Learning-Based Surface Defect Inspection System Using Multiscale and Channel-Compressed Features

Few-Shot Classification of Screen Defects with Class-Agnostic Mask and Context-Based Classifier.

TL-SDD: A Transfer Learning-Based Method for Surface Defect Detection with Few Samples

A New Cycle-consistent Adversarial Networks With Attention Mechanism for Surface Defect Classification With Small Samples

AEGLR-Net: Attention Enhanced Global-Local Refined Network for Accurate Detection of Car Body Surface Defects

Mask2Defect: A Prior Knowledge Based Data Augmentation Method for Metal Surface Defect Inspection

Few-shot Industrial Defect Image Classification Based on Lightweight Model with Attention Mechanism

Few-shot Defect Recognition of Metal Surfaces Via Attention-Embedding and Self-Supervised Learning

Cross-domain few-shot defect recognition for metal surfaces

CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation

Particleboard Surface Defect Inspection Based on Data Augmentation and Attention Mechanisms

ETDNet: Efficient Transformer-Based Detection Network for Surface Defect Detection

A Real-Time Surface Defect Detection System for Industrial Products with Long-Tailed Distribution

Defect transformer: An efficient hybrid transformer architecture for surface defect detection

DHT: Dynamic Vision Transformer Using Hybrid Window Attention for Industrial Defect Images Classification