Abstract:The current trend in automated optical inspection (AOI) systems employs deep learning models to detect defects on a metal surface. The setback of deep learning models is that they are time-consuming because the images obtained after every lighting adjustment must be used to train the deep learning models again and confirm whether the detection results have improved. To save the time spent using datasets to train deep networks, we proposed a comprehensive assessment score that combines defect visibility, visibility distribution, and overexposure based on the operation principles of convolution neural networks. It can be used to assess whether the training image dataset can improve the defect detection rate of the deep learning model such as You Only Look Once (YOLO), Single Shot MultiBox Detector (SSD), and Faster Region-based Convolutional Neural Network (Faster R-CNN) without training defect image datasets. We collected all of the weight combinations with the right prediction results and used linear regression to obtain the optimal weight coefficients. We found that visibility and overexposure had a greater impact on the comprehensive assessment score. We compared the proposed approach with existing image quality assessment methods, including mean absolute error (MAE), peak signal-to-noise ratio (PSNR), universal image quality index (UIQI), natural image quality evaluator (NIQE), perception-based quality evaluator (PIQE), and blind/referenceless image spatial quality evaluator (BRISQUE). The experiment results indicated that our proposed comprehensive assessment score is more correlated to the F2-score of the detection models than the IQA methods by the verification methods of Spearman Rank Correlation Coefficient (SRCC), Pearson Correlation, and Kendall Correlation. Thus, referring to this index during the collection of image data and choosing datasets with the highest score to train the model will produce better detection accuracy.

R-MSSIM: Image quality assessment while performing object detection

A blur insensitive structural similarity for image quality assessment

Structural similarity image quality assessment based on distortion model

MT-SSD: Single-Stage 3D Object Detector Based on Magnification Transformation

MicroSSIM: Improved Structural Similarity for Comparing Microscopy Data

MaD-DLS: Mean and Deviation of Deep and Local Similarity for Image Quality Assessment

SSIM Compliant Modeling Framework With Denoising and Deblurring Applications

SPSIM: A Superpixel-Based Similarity Index for Full-Reference Image Quality Assessment

SISIM: statistical information similarity-based point cloud quality assessment

A Quality Index Metric and Method for Online Self-Assessment of Autonomous Vehicles Sensory Perception

McmIQA: Multi-Module Collaborative Model for No-Reference Image Quality Assessment

FSIM: A Feature Similarity Index for Image Quality Assessment

Image Quality Assessment Based on Multi-Feature Extraction and Synthesis with Support Vector Regression

MPI: Multi-receptive and Parallel Integration for Salient Object Detection

Image Data Assessment Approach for Deep Learning-Based Metal Surface Defect-Detection Systems

Blind Image Quality Assessment Based on Multi-scale Spatial Pyramid Pooling.

An Optimized CNN-based Quality Assessment Model for Screen Content Image.

Region Mutual Information Loss for Semantic Segmentation

Object-QA: Towards High Reliable Object Quality Assessment.

Hierarchical Image Quality Improvement Based on Illumination, Resolution, and Noise Factors for Improving Object Detection

An Intelligent Remote Sensing Image Quality Inspection System