Abstract:Visual surface defect inspection provides an important tool for product quality assessment in a wide range of industrial applications. In recent years, diverse convolutional neural network (CNN) models have been devel-oped for the high-accuracy image classification of natural objects. However, it remains a challenging task to develop deep-learning-based approaches for surface defect inspection of industrial products. The main challenge is that surface defects of industrial products occur in low probability, therefore it is impractical to build a large image dataset containing different types of defects to train/fine-tune deep CNN models to achieve satisfactory performance when applied to industrial inspection tasks. To overcome the above-mentioned problem, we build a light-weight defect classification model based on the pre-trained SqueezeNet architecture and present three effective techniques to achieve high-accuracy defect classification using very few collected defective training samples. First, we experimentally demonstrate that it is reasonable to freeze shallower convolutional layers and only fine-tune deeper layers in the last convolutional stage when there are not enough training samples. Second, we integrate batch-size independent Group Normalization (GN) into SqueezeNet to compute stable statistics based on a limited number of defective samples for training the classification model. Third, we add an auxiliary task to perform the similarity comparison of two defective samples during the training phase, significantly increasing the size of the training data and generating more distinctive defect-specific representations. The experimental results on the NEU-CLS dataset and USB-FS dataset verify the effectiveness of the proposed method. Our method can obtain accurate defect classification results when very few defective training samples are provided, i.e., about 97.69% and 82.92% average classification accuracy on the NEU-CLS and USB-FS datasets, respectively, under the 5-shot setting (5 images per defect category).

On-the-fly image-level oversampling for imbalanced datasets of manufacturing defects

Defect segmentation for multi-illumination quality control systems

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

An Effective Industrial Defect Classification Method under the Few-Shot Setting Via Two-Stream Training

Few-shot defect detection using feature enhancement and image generation for manufacturing quality inspection

VOS: a Method for Variational Oversampling of Imbalanced Data

Enhancing robustness to novel visual defects through StyleGAN latent space navigation: a manufacturing use case

Geometric transformation-based data augmentation on defect classification of segmented images of semiconductor materials using a ResNet50 convolutional neural network

A Data Augmentation Methodology to Reduce the Class Imbalance in Histopathology Images

ALADA: A lite automatic data augmentation framework for industrial defect detection

Defect detection of injection molding products on small datasets using transfer learning

Defect Transfer GAN: Diverse Defect Synthesis for Data Augmentation

Diffusion-based Image Generation for In-distribution Data Augmentation in Surface Defect Detection

Support Vector based Oversampling Technique for Handling Class Imbalance in Software Defect Prediction

Enhancing Image Classification in Small and Unbalanced Datasets through Synthetic Data Augmentation

An intensity-based deep approach to mitigate step-imbalance problem under extreme paucity of images from rare classes

Augmented Hybrid Learning for Visual Defect Inspection in Real-World Hydrogen Storage Manufacturing Scenarios

A novel deep learning motivated data augmentation system based on defect segmentation requirements

Surface Defect Classification in Real-Time Using Convolutional Neural Networks

Investigating Shift Equivalence of Convolutional Neural Networks in Industrial Defect Segmentation

Pre-Trained Large Model Based Automatic Generation of Defect Insulator Images for Power Distribution Systems