Abstract:Visual surface defect inspection provides an important tool for product quality assessment in a wide range of industrial applications. In recent years, diverse convolutional neural network (CNN) models have been devel-oped for the high-accuracy image classification of natural objects. However, it remains a challenging task to develop deep-learning-based approaches for surface defect inspection of industrial products. The main challenge is that surface defects of industrial products occur in low probability, therefore it is impractical to build a large image dataset containing different types of defects to train/fine-tune deep CNN models to achieve satisfactory performance when applied to industrial inspection tasks. To overcome the above-mentioned problem, we build a light-weight defect classification model based on the pre-trained SqueezeNet architecture and present three effective techniques to achieve high-accuracy defect classification using very few collected defective training samples. First, we experimentally demonstrate that it is reasonable to freeze shallower convolutional layers and only fine-tune deeper layers in the last convolutional stage when there are not enough training samples. Second, we integrate batch-size independent Group Normalization (GN) into SqueezeNet to compute stable statistics based on a limited number of defective samples for training the classification model. Third, we add an auxiliary task to perform the similarity comparison of two defective samples during the training phase, significantly increasing the size of the training data and generating more distinctive defect-specific representations. The experimental results on the NEU-CLS dataset and USB-FS dataset verify the effectiveness of the proposed method. Our method can obtain accurate defect classification results when very few defective training samples are provided, i.e., about 97.69% and 82.92% average classification accuracy on the NEU-CLS and USB-FS datasets, respectively, under the 5-shot setting (5 images per defect category).

Causal deep learning for explainable vision-based quality inspection under visual interference

An Effective Industrial Defect Classification Method under the Few-Shot Setting Via Two-Stream Training

Coarse-to-Fine Few-Shot Defect Recognition with Dynamic Weighting and Joint Metric

Machine Vision Product Appearance Defect Detection Based on Deep Learning

A Deep Learning-Based Approach for the Automated Surface Inspection of Copper Clad Laminate Images

Reason induced visual attention for explainable autonomous driving

Machine vision intelligence for product defect inspection based on deep learning and Hough transform

Interpreting Low-level Vision Models with Causal Effect Maps

Causal Explaining Guided Domain Generalization for Rotating Machinery Intelligent Fault Diagnosis

Causal Interventional Training for Image Recognition

An Interactive Explanatory AI System for Industrial Quality Control

Causal reasoning in typical computer vision tasks

A One‐Stage Deep Learning Model for Industrial Defect Detection

Visual Product Inspection Based on Deep Learning Methods

Explainable AI for domain experts: a post Hoc analysis of deep learning for defect classification of TFT–LCD panels

Deep Learning Model Explainability for Inspection Accuracy Improvement in the Automotive Industry

Explaining the Behavior of Black-Box Prediction Algorithms with Causal Learning

Explainable deep neural network for in-plain defect detection during additive manufacturing

Explaining Deep Learning Models using Causal Inference

Contextual Debiasing for Visual Recognition with Causal Mechanisms

Causality Learning: A New Perspective for Interpretable Machine Learning