Abstract:Visual surface defect inspection provides an important tool for product quality assessment in a wide range of industrial applications. In recent years, diverse convolutional neural network (CNN) models have been devel-oped for the high-accuracy image classification of natural objects. However, it remains a challenging task to develop deep-learning-based approaches for surface defect inspection of industrial products. The main challenge is that surface defects of industrial products occur in low probability, therefore it is impractical to build a large image dataset containing different types of defects to train/fine-tune deep CNN models to achieve satisfactory performance when applied to industrial inspection tasks. To overcome the above-mentioned problem, we build a light-weight defect classification model based on the pre-trained SqueezeNet architecture and present three effective techniques to achieve high-accuracy defect classification using very few collected defective training samples. First, we experimentally demonstrate that it is reasonable to freeze shallower convolutional layers and only fine-tune deeper layers in the last convolutional stage when there are not enough training samples. Second, we integrate batch-size independent Group Normalization (GN) into SqueezeNet to compute stable statistics based on a limited number of defective samples for training the classification model. Third, we add an auxiliary task to perform the similarity comparison of two defective samples during the training phase, significantly increasing the size of the training data and generating more distinctive defect-specific representations. The experimental results on the NEU-CLS dataset and USB-FS dataset verify the effectiveness of the proposed method. Our method can obtain accurate defect classification results when very few defective training samples are provided, i.e., about 97.69% and 82.92% average classification accuracy on the NEU-CLS and USB-FS datasets, respectively, under the 5-shot setting (5 images per defect category).

Defect segmentation for multi-illumination quality control systems

Fusion of multi-light source illuminated images for effective defect inspection on highly reflective surfaces

A Sub-Region Unet for Weak Defects Segmentation with Global Information and Mask-Aware Loss.

Few-shot defect detection using feature enhancement and image generation for manufacturing quality inspection

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

Dual-Path GAN: A Method for Enhancing Small-scale Defect Detection on Metal Images

An Effective Industrial Defect Classification Method under the Few-Shot Setting Via Two-Stream Training

A novel deep learning motivated data augmentation system based on defect segmentation requirements

Multi-scale Attention and Dilation Network for Small Defect Detection

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

Deep Learning-Based Generic Automatic Surface Defect Inspection (ASDI) with Pixelwise Segmentation

Multi-modal background-aware for defect semantic segmentation with limited data

Improving Deep Learning-based Defect Detection on Window Frames with Image Processing Strategies

TruingDet: Towards High-Quality Visual Automatic Defect Inspection for Mental Surface

Quasi Real-Time Apple Defect Segmentation Using Deep Learning

On-the-fly image-level oversampling for imbalanced datasets of manufacturing defects

An Adaptive Image Segmentation Network for Surface Defect Detection

AnomalySeg: Deep Learning-Based Fast Anomaly Segmentation Approach for Surface Defect Detection

Image Data Assessment Approach for Deep Learning-Based Metal Surface Defect-Detection Systems

Bilateral Guidance Network for One-Shot Metal Defect Segmentation

Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs