Abstract:An instantaneous and precise coating inspection method is imperative to mitigate the risk of flaws, defects, and discrepancies on coated surfaces. While many studies have demonstrated the effectiveness of automated visual inspection (AVI) approaches enhanced by computer vision and deep learning, critical challenges exist for practical applications in the manufacturing domain. Computer vision has proven to be inflexible, demanding sophisticated algorithms for diverse feature extraction. In deep learning, supervised approaches are constrained by the need for annotated datasets, whereas unsupervised methods often result in lower performance. Addressing these challenges, this paper proposes a novel deep learning-based automated visual inspection (AVI) framework designed to minimize the necessity for extensive feature engineering, programming, and manual data annotation in classifying fuel injection nozzles and discerning their coating interfaces from scratch. This proposed framework comprises six integral components: It begins by distinguishing between coated and uncoated nozzles through gray level co-occurrence matrix (GLCM)-based texture analysis and autoencoder (AE)-based classification. This is followed by cropping surface images from uncoated nozzles, and then building an AE model to estimate the coating interface locations on coated nozzles. The next step involves generating autonomously annotated datasets derived from these estimated coating interface locations. Subsequently, a convolutional neural network (CNN)-based detection model is trained to accurately localize the coating interface locations. The final component focuses on enhancing model performance and trustworthiness. This framework demonstrated over 95% accuracy in pinpointing the coating interfaces within the error range of ± 6 pixels and processed at a rate of 7.18 images per second. Additionally, explainable artificial intelligence (XAI) techniques such as t-distributed stochastic neighbor embedding (t-SNE) and the integrated gradient substantiated the reliability of the models.

In-process vision monitoring methods for aircraft coating laser cleaning based on deep learning

In-situ monitoring laser based directed energy deposition process with deep convolutional neural network

Image-based Process Monitoring Using Deep Learning Framework

Real-time monitoring and quality assurance for laser-based directed energy deposition: integrating co-axial imaging and self-supervised deep learning framework

Deep Learning Based Monitoring of Spatter Behavior by the Acoustic Signal in Selective Laser Melting

Visual coating inspection framework via self-labeling and multi-stage deep learning strategies

A Review of Dynamic Monitoring Technology and Application Research of Laser Cleaning Interface

Image-Based Process Monitoring Using Deep Belief Networks

Deep Learning-based Method for PV Panels Segmentation and Defects Detection with Infrared Images

Supervised deep learning for real-time quality monitoring of laser welding with X-ray radiographic guidance

Research on Oriented Surface Defect Detection in the Aircraft Skin‐coating Process Based on an Attention Detector

Deep learning-based monitoring of surface residual stress and efficient sensing of AE for laser shock peening

Multi-Output Monitoring of High-Speed Laser Welding State Based on Deep Learning

Nondestructive detection of laser-cladding coating interface defects: a deep learning-enhanced laser ultrasonics approach

Method and Application of Spraying Developer Defect Detection in Three-Dimensional Optical Scanning Measurement Process Based on YOLO v7

Research on LIBS online monitoring criteria for aircraft skin laser paint removal based on OPLS-DA

Deep learning-based borescope image processing for aero-engine blade in-situ damage detection

Machine Vision-based in Situ Monitoring of Laser Cladding Molten Pool Features

Online Visual Monitoring Method for Liquid Rocket Engine Nozzle Welding Based on a Multi-Task Deep Learning Model

Recent advances in surface defect inspection of industrial products using deep learning techniques

Laser ultrasonic inspection of surface and subsurface defects in materials based on deep learning