Abstract:Many "Industry 4.0" applications rely on data-driven methodologies such as Machine Learning and Deep Learning to enable automatic tasks and implement smart factories. Among these applications, the automatic quality control of manufacturing materials is of utmost importance to achieve precision and standardization in production. In this regard, most of the related literature focused on combining Deep Learning with Nondestructive Testing techniques, such as Infrared Thermography, requiring dedicated settings to detect and classify defects in composite materials. Instead, the research described in this paper aims at understanding whether deep neural networks and transfer learning can be applied to plain images to classify surface defects in carbon look components made with Carbon Fiber Reinforced Polymers used in the automotive sector. To this end, we collected a database of images from a real case study, with 400 images to test binary classification (defect vs. no defect) and 1500 for the multiclass classification (components with no defect vs. recoverable vs. non-recoverable). We developed and tested ten deep neural networks as classifiers, comparing ten different pre-trained CNNs as feature extractors. Specifically, we evaluated VGG16, VGG19, ResNet50 version 2, ResNet101 version 2, ResNet152 version 2, Inception version 3, MobileNet version 2, NASNetMobile, DenseNet121, and Xception, all pre-trainined with ImageNet, combined with fully connected layers to act as classifiers. The best classifier, i.e., the network based on DenseNet121, achieved a 97% accuracy in classifying components with no defects, recoverable components, and non-recoverable components, demonstrating the viability of the proposed methodology to classify surface defects from images taken with a smartphone in varying conditions, without the need for dedicated settings. The collected images and the source code of the experiments are available in two public, open-access repositories, making the presented research fully reproducible.

Optical Film Damage Classification Based on Neural Network

Evaluation of Chracteristic of Optical Thin Film By Neural Network System

Optical Analog Computing Devices Designed by Deep Neural Network

Simplifying the detection of optical distortions by machine learning

Novel Framework for Optical Film Defect Detection and Classification

Advanced cover glass defect detection and classification based on multi-DNN model

Quantifying Defects in Thin Films using Machine Vision

Quality Control of Carbon Look Components via Surface Defect Classification with Deep Neural Networks

Motion-blurry Image Restoration Method for Detecting Surface Defects of Wood Veneer

Automatic Cataract Detection And Grading Using Deep Convolutional Neural Network

MFSF-Net: A Multiscale Feature and Side-Outputs Fusion Network for Pixelwise Catastrophic Optical Damage Detection

Inspection and Classification of Semiconductor Wafer Surface Defects Using CNN Deep Learning Networks

Automatic Identification and Classification of Surface Defects in Small-Sized Optics

Automatic Detection and Classification of Natural Weld Defects Using Alternating Magneto-Optical Imaging and ResNet50

Automatic optical inspection platform for real-time surface defects detection on plane optical components based on semantic segmentation

Classification of Cataract Fundus Image Based on Deep Learning

Automatic Defect Classification for Infrared Thermography in CFRP based on Deep Learning Dense Convolutional Neural Network

From Machine to Machine: An OCT-trained Deep Learning Algorithm for Objective Quantification of Glaucomatous Damage in Fundus Photographs

Automated Quality Control of Vacuum Insulated Glazing by Convolutional Neural Network Image Classification

Multi-Axis 3D Printing Defect Detecting by Machine Vision with Convolutional Neural Networks

Inspection of sandblasting defect in investment castings by deep convolutional neural network