Abstract:In modern production environments, advanced and intelligent process monitoring strategies are required to enable an unambiguous diagnosis of the process situation and thus of the final component quality. In addition, the ability to recognize the current state of product quality in real-time is an important prerequisite for autonomous and self-improving manufacturing systems. To address these needs, this study investigates a novel ensemble deep learning architecture based on convolutional neural networks (CNN), gated recurrent units (GRU) combined with high-performance classification algorithms such as k-nearest neighbors (kNN) and support vector machines (SVM). The architecture uses spatio-temporal features extracted from infrared image sequences to locate critical welding defects including lack of fusion (false friends), sagging, lack of penetration, and geometric deviations of the weld seam. In order to evaluate the proposed architecture, this study investigates a comprehensive scheme based on classical machine learning methods using manual feature extraction and state-of-the-art deep learning algorithms. Optimal hyperparameters for each algorithm are determined by an extensive grid search. Additional work is conducted to investigate the significance of various geometrical, statistical and spatio-temporal features extracted from the keyhole and weld pool regions. The proposed method is finally validated on previously unknown welding trials, achieving the highest detection rates and the most robust weld defect recognition among all classification methods investigated in this work. Ultimately, the ensemble deep neural network is implemented and optimized to operate on low-power embedded computing devices with low latency (1.1 ms), demonstrating sufficient performance for real-time applications.

Defect detection during laser welding using electrical signals and high-speed photography

EMD- PNN Based Welding Defects Detection Using Laser-Induced Plasma Electrical Signals

Monitoring and detecting of defects during fiber laser welding

Defects Diagnosis in Laser Brazing Using Near-Infrared Signals Based on Empirical Mode Decomposition

Quantitative Detection of Laser Welding Defective Structure Based on Feature Exaction of the Pulsed Eddy Current Signal

Defect detection method using laser vision with model-based segmentation for laser brazing welds on car body surface

Detection of laser-induced plasma for high-power laser beam welding

Machine-vision-based Defect Detection Using Circular Hough Transform in Laser Welding

Dynamic Features of Plasma Plume and Molten Pool in Laser Lap Welding Based on Image Monitoring and Processing Techniques

Study on Porosity Defect Detection in Narrow Gap Laser Welding Based on Spectral Diagnosis

Multi-sensing Signals Diagnosis and CNN-based Detection of Porosity Defect During Al Alloys Laser Welding

Finite element simulation of laser-generated ultrasonic waves for quantitative detection of internal defects in welds

In-process Monitoring of Penetration Depth and Contact Width During Laser Lap Welding Using Fused OCT Depth and Coaxial High Speed Image

A Spatio-Temporal Ensemble Deep Learning Architecture for Real-Time Defect Detection during Laser Welding on Low Power Embedded Computing Boards

Plasma light emission monitoring and penetration status recognition in CO2 laser welding of AZ31B wrought magnesium alloy - art. no. 682502

Development of the Plasma Detecting System in CO 2 Laser Welding

Online Defect Detection of Al Alloy in Arc Welding Based on Feature Extraction of Arc Spectroscopy Signal

Online Detection Method of Weld Penetration Based on Molten Pool Morphology and Metallic Vapor Radiation for Fiber Laser Welding

Study on surface defects recognition of circumferential laser weld based on visual inspection technology

Application of laser ultrasonic technique for detecting weld defect based on FDST method

Laser welding monitoring techniques based on optical diagnosis and artificial intelligence: a review