Abstract:In modern production environments, advanced and intelligent process monitoring strategies are required to enable an unambiguous diagnosis of the process situation and thus of the final component quality. In addition, the ability to recognize the current state of product quality in real-time is an important prerequisite for autonomous and self-improving manufacturing systems. To address these needs, this study investigates a novel ensemble deep learning architecture based on convolutional neural networks (CNN), gated recurrent units (GRU) combined with high-performance classification algorithms such as k-nearest neighbors (kNN) and support vector machines (SVM). The architecture uses spatio-temporal features extracted from infrared image sequences to locate critical welding defects including lack of fusion (false friends), sagging, lack of penetration, and geometric deviations of the weld seam. In order to evaluate the proposed architecture, this study investigates a comprehensive scheme based on classical machine learning methods using manual feature extraction and state-of-the-art deep learning algorithms. Optimal hyperparameters for each algorithm are determined by an extensive grid search. Additional work is conducted to investigate the significance of various geometrical, statistical and spatio-temporal features extracted from the keyhole and weld pool regions. The proposed method is finally validated on previously unknown welding trials, achieving the highest detection rates and the most robust weld defect recognition among all classification methods investigated in this work. Ultimately, the ensemble deep neural network is implemented and optimized to operate on low-power embedded computing devices with low latency (1.1 ms), demonstrating sufficient performance for real-time applications.

Monitoring of distance between laser beam and arc in laser-arc hybrid welding based on deep learning

Defect monitoring of high-power laser-arc hybrid welding process based on an improved channel attention convolutional neural network

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Online Visual Monitoring Method for Liquid Rocket Engine Nozzle Welding Based on a Multi-Task Deep Learning Model

Multi-Output Monitoring of High-Speed Laser Welding State Based on Deep Learning

Weld image deep learning-based on-line defects detection using convolutional neural networks for Al alloy in robotic arc welding

How to Accurately Monitor the Weld Penetration From Dynamic Weld Pool Serial Images Using CNN-LSTM Deep Learning Model?

Deep learning-based monitoring system for predicting top and bottom bead widths during the laser welding of aluminum alloy

Online monitoring system for welding states of bottom-locking joints in high-speed trains via multi-information fusion and 3DCNN

Real-time recognition of arc weld pool using image segmentation network

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

Burn-through prediction and weld depth estimation by deep learning model monitoring the molten pool in gas metal arc welding with gap fluctuation

In situ monitoring and penetration prediction of plasma arc welding based on welder intelligence-enhanced deep random forest fusion

Machine Learning-Based In-Process Monitoring for Laser Deep Penetration Welding: A Survey

Supervised deep learning for real-time quality monitoring of laser welding with X-ray radiographic guidance

Industrial Laser Welding Defect Detection and Image Defect Recognition Based on Deep Learning Model Developed

In-process comprehensive prediction of bead geometry for laser wire-feed DED system using molten pool sensing data and multi-modality CNN

A Spatio-Temporal Ensemble Deep Learning Architecture for Real-Time Defect Detection during Laser Welding on Low Power Embedded Computing Boards

Investigating the ability of deep learning to predict Welding Depth and Pore Volume in Hairpin Welding

Real-Time High-Performance Laser Welding Defect Detection by Combining ACGAN-Based Data Enhancement and Multi-Model Fusion

Defects Detection of GMAW Process Based on Convolutional Neural Network Algorithm.