Abstract:Many "Industry 4.0" applications rely on data-driven methodologies such as Machine Learning and Deep Learning to enable automatic tasks and implement smart factories. Among these applications, the automatic quality control of manufacturing materials is of utmost importance to achieve precision and standardization in production. In this regard, most of the related literature focused on combining Deep Learning with Nondestructive Testing techniques, such as Infrared Thermography, requiring dedicated settings to detect and classify defects in composite materials. Instead, the research described in this paper aims at understanding whether deep neural networks and transfer learning can be applied to plain images to classify surface defects in carbon look components made with Carbon Fiber Reinforced Polymers used in the automotive sector. To this end, we collected a database of images from a real case study, with 400 images to test binary classification (defect vs. no defect) and 1500 for the multiclass classification (components with no defect vs. recoverable vs. non-recoverable). We developed and tested ten deep neural networks as classifiers, comparing ten different pre-trained CNNs as feature extractors. Specifically, we evaluated VGG16, VGG19, ResNet50 version 2, ResNet101 version 2, ResNet152 version 2, Inception version 3, MobileNet version 2, NASNetMobile, DenseNet121, and Xception, all pre-trainined with ImageNet, combined with fully connected layers to act as classifiers. The best classifier, i.e., the network based on DenseNet121, achieved a 97% accuracy in classifying components with no defects, recoverable components, and non-recoverable components, demonstrating the viability of the proposed methodology to classify surface defects from images taken with a smartphone in varying conditions, without the need for dedicated settings. The collected images and the source code of the experiments are available in two public, open-access repositories, making the presented research fully reproducible.

Deep Neural Network Recognition of Rivet Joint Defects in Aircraft Products

A Novel Defect Detection System for Complex Freeform Surface Structures

Aviation Rivet Classification and Anomaly Detection Based on Deep Learning

A visual inspection and diagnosis system for bridge rivets based on a convolutional neural network

Explainable deep neural network for in-plain defect detection during additive manufacturing

Deep Learning Based Feature Discriminability Boosted Concurrent Metal Surface Defect Detection System Using YOLOv-5s-FRN

A Defect Detection Method for Rail Surface and Fasteners Based on Deep Convolutional Neural Network

Automated Metal Surface Flaws Detection Using Convolutional Neural Network and Deep Visualization Analysis

Research on Recognition Technology of Aluminum Profile Surface Defects Based on Deep Learning

RRCNet: Rivet Region Classification Network for Rivet Flush Measurement Based on 3-D Point Cloud

Integration of Deep Learning Network and Robot Arm System for Rim Defect Inspection Application

Quality Control of Carbon Look Components via Surface Defect Classification with Deep Neural Networks

Automatic Defect Recognition Method of Aluminium Profile Surface Defects

Forming process prediction of a self-piercing riveted joint in carbon fibre reinforced composites and aluminium alloy based on deep learning

A Hard Voting Policy-Driven Deep Learning Architectural Ensemble Strategy for Industrial Products Defect Recognition and Classification

Automatic Detection of Welding Defects Using Deep Neural Network

Applying Deep Neural Networks to automate visual verification of manual bracket installations in aerospace

Aircraft Fuselage Corrosion Detection Using Artificial Intelligence

Deep convolutional neural network for weld defect classification in radiographic images

Automated System for Visual Non-Destructive Testing

Deep learning methods for roping defect analysis in aluminum alloy sheets: prediction and grading