Abstract:In modern production environments, advanced and intelligent process monitoring strategies are required to enable an unambiguous diagnosis of the process situation and thus of the final component quality. In addition, the ability to recognize the current state of product quality in real-time is an important prerequisite for autonomous and self-improving manufacturing systems. To address these needs, this study investigates a novel ensemble deep learning architecture based on convolutional neural networks (CNN), gated recurrent units (GRU) combined with high-performance classification algorithms such as k-nearest neighbors (kNN) and support vector machines (SVM). The architecture uses spatio-temporal features extracted from infrared image sequences to locate critical welding defects including lack of fusion (false friends), sagging, lack of penetration, and geometric deviations of the weld seam. In order to evaluate the proposed architecture, this study investigates a comprehensive scheme based on classical machine learning methods using manual feature extraction and state-of-the-art deep learning algorithms. Optimal hyperparameters for each algorithm are determined by an extensive grid search. Additional work is conducted to investigate the significance of various geometrical, statistical and spatio-temporal features extracted from the keyhole and weld pool regions. The proposed method is finally validated on previously unknown welding trials, achieving the highest detection rates and the most robust weld defect recognition among all classification methods investigated in this work. Ultimately, the ensemble deep neural network is implemented and optimized to operate on low-power embedded computing devices with low latency (1.1 ms), demonstrating sufficient performance for real-time applications.

Real-time monitoring of high-power disk laser welding statuses based on deep learning framework

Multi-Output Monitoring of High-Speed Laser Welding State Based on Deep Learning

Supervised deep learning for real-time quality monitoring of laser welding with X-ray radiographic guidance

Design of Real-time Monitoring System for Laser Penetration Welding

Prediction of high power laser welding status based on PCA and SVM classification of multiple sensors

Early Event Detection in a Deep-Learning Driven Quality Prediction Model for Ultrasonic Welding

Machine Learning-Based In-Process Monitoring for Laser Deep Penetration Welding: A Survey

A Spatio-Temporal Ensemble Deep Learning Architecture for Real-Time Defect Detection during Laser Welding on Low Power Embedded Computing Boards

Laser welding monitoring techniques based on optical diagnosis and artificial intelligence: a review

Review of laser welding monitoring

Laser Welding Penetration Monitoring Based on Time-Frequency Characterization of Acoustic Emission and CNN-LSTM Hybrid Network

Research on a Feature Point Detection Algorithm for Weld Images Based on Deep Learning

Monitoring of distance between laser beam and arc in laser-arc hybrid welding based on deep learning

High-resolution Weld Defect Detection with RSU-MLP and Dynamic Kernel Supervision

Deep learning-based monitoring system for predicting top and bottom bead widths during the laser welding of aluminum alloy

Online monitoring system for welding states of bottom-locking joints in high-speed trains via multi-information fusion and 3DCNN

Real-time monitoring of weld surface morphology with lightweight semantic segmentation model improved by attention mechanism during laser keyhole welding

In situ monitoring and penetration prediction of plasma arc welding based on welder intelligence-enhanced deep random forest fusion

Real-time Weld Geometry Prediction Based on Multi-Information Using Neural Network Optimized by PCA and GA During Thin-Plate Laser Welding

Progress and Perspectives of In-Situ Optical Monitoring in Laser Beam Welding: Sensing, Characterization and Modeling

Real-Time High-Performance Laser Welding Defect Detection by Combining ACGAN-Based Data Enhancement and Multi-Model Fusion