Abstract:The current trend in automated optical inspection (AOI) systems employs deep learning models to detect defects on a metal surface. The setback of deep learning models is that they are time-consuming because the images obtained after every lighting adjustment must be used to train the deep learning models again and confirm whether the detection results have improved. To save the time spent using datasets to train deep networks, we proposed a comprehensive assessment score that combines defect visibility, visibility distribution, and overexposure based on the operation principles of convolution neural networks. It can be used to assess whether the training image dataset can improve the defect detection rate of the deep learning model such as You Only Look Once (YOLO), Single Shot MultiBox Detector (SSD), and Faster Region-based Convolutional Neural Network (Faster R-CNN) without training defect image datasets. We collected all of the weight combinations with the right prediction results and used linear regression to obtain the optimal weight coefficients. We found that visibility and overexposure had a greater impact on the comprehensive assessment score. We compared the proposed approach with existing image quality assessment methods, including mean absolute error (MAE), peak signal-to-noise ratio (PSNR), universal image quality index (UIQI), natural image quality evaluator (NIQE), perception-based quality evaluator (PIQE), and blind/referenceless image spatial quality evaluator (BRISQUE). The experiment results indicated that our proposed comprehensive assessment score is more correlated to the F2-score of the detection models than the IQA methods by the verification methods of Spearman Rank Correlation Coefficient (SRCC), Pearson Correlation, and Kendall Correlation. Thus, referring to this index during the collection of image data and choosing datasets with the highest score to train the model will produce better detection accuracy.

Automated Detection of Defects with Low Semantic Information in X-ray Images Based on Deep Learning

Approaches for Accuracy Improvement of the X-ray Image Defect Detection of Automobile Casting Aluminum Parts Based on Deep Learning

Interactive Defect Segmentation in X-Ray Images Based on Deep Learning

Automatic Defect Segmentation in X-Ray Images Based on Deep Learning

Approach for Automatic Defect Detection in Aluminum Casting X-Ray Images Using Deep Learning and Gain-Adaptive Multi-Scale Retinex

A high efficiency deep learning method for the x-ray image defect detection of casting parts

Detection of a casting defect tracked by deep convolution neural network

A nondestructive automatic defect detection method with pixelwise segmentation

Coarse-to-Fine Few-Shot Defect Recognition with Dynamic Weighting and Joint Metric

A Sub-Region Unet for Weak Defects Segmentation with Global Information and Mask-Aware Loss.

Deep Learning Based Defect Detection for Solder Joints on Industrial X-Ray Circuit Board Images

Visual Defect Inspection of Metal Part Surface via Deformable Convolution and Concatenate Feature Pyramid Neural Networks

Deep learning based solder joint defect detection on industrial printed circuit board X-ray images

High-performance deep learning segmentation for non-destructive testing of X-ray tomography

Low Cost and Highly Sensitive Automated Surface Defects Identification Method of Precision Castings Using Deep Learning

Automatic Defect Detection in X-ray Images Using Image Data Fusion

A Lightweight Deep Network for Defect Detection of Insert Molding Based on X-ray Imaging

Decision Fusion Network with Perception Fine-tuning for Defect Classification

Image Data Assessment Approach for Deep Learning-Based Metal Surface Defect-Detection Systems

LE–MSFE–DDNet: a defect detection network based on low-light enhancement and multi-scale feature extraction

Automated defect detection in digital radiography of aerospace welds using deep learning